Work options: On-Site Office locations in Sydney and Melbourne CBD. We’re looking for a senior Software Engineer with deep expertise in Python , AWS , and PySpark to help build production-grade data processing and platform services for financial services use cases. If you love solving complex problems, automating everything, and owning high-impact features end-to-end, this role is for you. You’ll be part of a collaborative engineering squad that champions a shift-left quality culture , strong automation, and resilient design — all while working with a modern AWS-native stack (Glue, EMR, S3, Airflow, Spark) and robust CI/CD practices. What You’ll Do Build scalable, reliable services and data pipelines using Python , PySpark , and AWS (Glue, EMR, S3). Embed automation across testing, security, and deployment, including unit, integration, and contract tests. Design and operate workflows using Airflow and AWS Glue , optimising for performance, reliability, and cost. Collaborate across product, platform, and QA teams to deliver systems that are testable, observable, and resilient. Own features end-to-end — design, implementation, code review, performance tuning, deployment, and production support. Contribute to engineering standards, DevSecOps practices, and continuous delivery improvements. Mentor engineers and uplift team capability, tooling, and engineering best practice. Mandatory skills & experience: 8 years software engineering experience with strong Python development skills. Expertise in AWS Glue , PySpark , SQL , and large-scale data processing on AWS. Hands-on experience designing automation frameworks and working in microservices environments. Strong familiarity with observability tools (CloudWatch, Splunk, metrics, logging, tracing). Technical strengths we value: Python and shell scripting in Linux environments Airflow orchestration (DAG design, retries, SLAs) SQL for data transformation and analysis (Teradata/Oracle exposure a plus) CI/CD pipelines and shift-left testing (TeamCity, GitHub Actions, Jenkins, Octopus) Cloud-native engineering principles (scalability, security, cost optimisation) Effective use of AI development tools (e.g., GitHub Copilot, Roo Code) Nice to Have Experience with Ab Initio or SAS for legacy ETL migrations Knowledge of Redshift, Athena, EMR, or Iceberg API/microservices integration and testing Contract testing and modern test automation frameworks (Playwright, Appium, DevTest, Sahi) Dashboarding and reporting for engineering or operational insights Team leadership or mentoring experience Why Join Us? Work with a modern, cloud-native, high-scale AWS ecosystem Solve meaningful technical problems in a highly skilled engineering squad Drive best practices, automation, and engineering standards Opportunity to influence architecture, tooling, and the developer experience
