Senior Data Engineer | Python Location: Sydney Employment Type: Contract About INGRITY: The Company INGRITY is a Microsoft data and AI solution partner, working closely with Microsoft to create value for our customers. We collaborate with some of the best ASX-listed companies and many medium-sized businesses, delivering transformative data and AI-driven solutions. Our success is built on innovation, customer advocacy, and our strategic partnership with Microsoft. About the Role: We are seeking a Senior Data Engineer with a strong background in data pipeline architecture, ETL/ELT development, and AI/ML data preparation using Python. This role is pivotal in driving our strategic shift toward Python-based data engineering, supporting a multi-agent AI framework, and modernizing data ingestion workflows for BI platforms. You will lead initiatives across advanced data processing, pattern ingestion, and automation — playing a hands-on role in both implementation and strategic design. Key Responsibilities: Lead the build of scalable data engineering solutions using Python for a multi-agent AI framework Develop and enhance Python logic for automated data transformation, and delivery Design and implement pattern-based ingestion pipelines to feed structured data into BI tools Execute weekly Python scripting tasks to support data processing and operational automation Create and maintain detailed design documentation for data pipelines and AI framework components Support the migration of Alteryx flows to Python, providing guidance or hands-on assistance as needed Maintain and operate production-grade Python processes supporting newly integrated and migrated data assets Collaborate with cross-functional teams to align data solutions with analytics and business needs Required Skills & Experience: 5 years of professional experience in Python with a strong focus on data engineering Solid hands-on expertise with data handling libraries Strong understanding of ETL/ELT principles, data pipeline architecture, and API integration Experience preparing and transforming data for AI/ML models and analytical platforms Proficient in cloud data platforms such as AWS S3, Redshift, Snowflake, or BigQuery Strong understanding of conceptual data modeling and data orchestration tools (e.g., Airflow) Demonstrated problem-solving mindset with the ability to understand and navigate end-to-end processes Excellent communication, and documentation skills Nice to Have: Understanding of Alteryx workflows and experience supporting migration to Python Note : This position is based Sydney, Australia. The candidate must have full working rights in Australia to be eligible for this role.
