Data Engineers (Databricks, AWS, Python) Location: Melbourne or Sydney / Hybrid Role Type: Data Engineers (Mid to Senior Level, including Technical Lead opportunities) Contract Duration: 6 to 12 months Industry: Insurance / Superannuation About the Role We are seeking highly skilled Data Engineers (from mid-level through to senior technical leads) with strong experience in Databricks, AWS, PySpark, and Python . These roles are central to supporting large-scale data analytics, cloud migration, and automation initiatives, with the opportunity to step into a lead/technical leadership position for senior candidates. You will play a hands-on role in building scalable and secure data solutions, migrating on-premises assets to AWS, and leveraging GenAI automation to streamline workflows. Key Responsibilities Design, develop, and implement data pipelines and scalable solutions using Databricks, PySpark, Python, and SQL . Lead or contribute to data migration projects from on-premises environments to AWS. Apply GenAI automation tools to improve migration, transformation, and workflow efficiency. Build and optimise data models and deliver actionable insights to business stakeholders. Ensure data integrity through thorough quality checks, cleaning, and transformation processes . Automate repetitive data preparation and processing tasks for scalability. (For senior/lead roles) Provide technical leadership , manage risks/issues proactively, and engage stakeholders with clarity and confidence. Required Experience & Skills 5 years’ experience (10 years for Senior/Lead roles) in Data Engineering or Data Analytics. Strong proficiency with Databricks, AWS, PySpark, Python , and SQL . Proven expertise in data migration projects and cloud-based data architectures. Hands-on experience with GenAI automation for data migration and optimisation. Knowledge of Databricks Job APIs, Workflows, Unity Catalog, and Workspaces (advantageous). Strong ability to automate workflows, follow best coding practices, and document processes. Behavioral Competencies Excellent communication skills with the ability to engage non-technical stakeholders. Highly proactive , with strong issue and risk management skills. Self-directed and resourceful, able to operate with minimal supervision. Collaborative team player with strong problem-solving and critical thinking skills. For senior/lead roles: strong leadership, mentoring, and stakeholder engagement abilities.
