Location : Sydney (Hybrid Flexibility) Engagement : Contract (Likely Extensions) Client : Major Insurance & Financial Services Organisation Advance Thinking is seeking an experienced Senior Data Engineer with strong data capabilities to support a key regulatory uplift program for our enterprise client. In this role you will be a member of a platform team, building the data and analytics platform. The role works alongside different functions to develop the data platform by understanding the core system data structures, data processing architecture and designing data pipelines. Responsibilities: Design and development of data engineering assets and scalable feature engineering frameworks to support various Business Unit’s data demands and internal data science activities. Evaluate feature importance and manage production of data features. Create and maintain optimal data pipeline architecture. Develop ETL solutions on Python, Databricks, Spark, Microsoft Azure Technology Stack to load data across multiple sources into the Data and Analytics platform. Implement solutions that adhere to architecture best practices. Contribute to our ambition to develop a best practice Data and Analytics platform, leveraging next generation technologies. Define and build the data pipelines that will enable faster, better, data-informed decision-making within the business. Work Experience: Experience working on Azure Cloud and good knowledge on the modern data platform - Azure Synapse, Azure Databricks etc Experience in data management, architecture, solution designing, and delivery. Experience in building Azure environment using Infrastructure as Code with the help of tools like Terraform etc. Demonstrated experience in Data Mapping and data Modelling (3NF, Star-schema, Big Tables, Columnar, Key-value pair, and JSON based documents). Experience working in data engineering, information architecture, and data platforms design, including data warehouse technical architectures, ETL, batch designs, and parallel processing. Solid understanding of Data and Analytics principles and data management/quality capabilities needed to support analytic reporting. Experience in building data streams, batch, and real-time data pipelines. Sound like you? Apply now or get in touch with Advance Thinking to discuss the role further.
