Data Engineer – 6-Month Contract with Extensions Location: Sydney, Melbourne, or Adelaide (Hybrid) Overview We are seeking an experienced Data Engineer to join a high-performing team delivering enterprise-scale data solutions across the Azure ecosystem. This multi-year transformation program, projected through to 2028, is focused on modernising data systems and pipelines to support strategic decision-making and business growth. You’ll work collaboratively with cross-functional teams including Data Science, Architecture, and Solution Design, contributing to the design, optimisation, and delivery of modern, scalable, and efficient data solutions in Azure. Key Responsibilities Design, develop, and optimise end-to-end data pipelines, data warehousing solutions, and ETL jobs using Azure Databricks, Azure Synapse, and Azure Data Factory. Build and enhance ETL workflows using Azure Logic Apps, ensuring seamless data integration and automation. Develop and maintain high-quality, production-grade code in Python, SQL, and PySpark. Manage data ingestion, transformation, and storage within Azure Data Lake, ensuring performance, scalability, and reliability. Collaborate with Data Scientists, Solution Designers, and Technical Architects to integrate and optimise data frameworks for downstream analytics and business reporting. Contribute to data architecture, governance, and security standards across the organisation. Troubleshoot and optimise existing pipelines to improve performance, cost efficiency, and maintainability. Core Tech Stack Languages/Tools: Python, SQL, PySpark, Azure Databricks, Azure Synapse Analytics, Azure Logic Apps, Azure Data Factory Environment: Azure Cloud, DevOps, CI/CD pipelines Legacy systems: Limited exposure to SSIS, SSRS, Power BI, and on-prem SQL Server (less than 10% of the work) About You Minimum 5 years of data engineering experience, with at least 2 years in Azure and Databricks environments. Proven experience in building scalable, cloud-based data solutions. Strong knowledge of data modelling, ETL development, and data warehousing concepts. Hands-on experience exposing data to Power BI or other business-facing tools using Synapse. Familiarity with data governance, metadata management, and data quality frameworks. Strong communication and collaboration skills, with a positive, flexible attitude and proactive problem-solving mindset. Background in insurance or financial services (particularly with systems such as Guidewire or Evolve) is highly regarded. Working Environment Flexible hybrid model, typically 1 day per week in the office (Sydney and Melbourne – Wednesday). Contract extensions are highly likely, as this role forms part of a long-term, enterprise-wide transformation initiative funded through 2028.
