This role is available in Canberra, Newcastle, Sydney, Brisbane, Adelaide and Melbourne 12 months with 2*12month extension Australian citizenship with Baseline clearance mandatory About the Team Our client is seeking a dedicated Data Engineer to join our dynamic development team that manages solutions on the AWS Cloud Ecosystem. You will be working with a large group of technical specialists across different areas and will be instrumental in undertaking data integration and building scalable data pipelines to support AI projects. It is essential that the candidate has experience integrating multiple source data systems with AWS Cloud platforms and developing scalable data pipelines and workflows. Established domain knowledge with data processing for AI systems and experience with relevant AWS Cloud services is highly desirable Key Responsibilities: Build, maintain, and optimise batch and streaming data pipelines for ingesting, processing, and transforming large volumes of data using AWS services (e.g. S3, Glue, Lambda, Step Functions, Kinesis, Redshift, Athena), ensuring performance, reliability, and cost efficiency. Develop, integrate and manage ETL/ELT workflows from multiple source systems (APIs, databases, files, streaming sources) Ensure data quality, integrity, and reliability through validation, monitoring, and testing Skills and experience: 5 years' experience delivering enterprise data integration and pipeline solutions in AWS Hand-on experience building, maintaining and optimising batch and streaming data pipelines for ingesting, processing, and transforming large volumes of data using AWS services (e.g. S3, Glue, Lambda, Step Functions, Kinesis, Redshift, Athena) Hand-on experience integrating multiple data source systems with an AWS cloud platform e.g. data lake/warehouse/API Hands-on experience with ETL/ELT tools and frameworks Strong proficiency with SQL and Python Experience with Infrastructure as Code (Terraform/Ansible) Experience building and running workloads on Kubernetes. Minimum tertiary level qualification in Computer Science, Information Technology or equivalent This role is available in Canberra, Newcastle, Sydney, Brisbane, Adelaide and Melbourne If you wish to apply for this position, please submit your resume by clicking the 'Apply Now' button. For further information please contact Richa Agarwal at Clicks IT Recruitment on 61 438 296 880. At Clicks we embrace diversity, inclusion and equal opportunity. First Nations people are encouraged to apply. We provide reasonable adjustments, including alternate formats to the recruitment process for individuals with disability. If you require an adjustment to be made during the recruitment process, please call 1300 254 257 or email adjustments@clicks.com.au Apply Now Job Summary Pay: $130 per hour Location: VIC - Other Job Type: Contract Specialisation: Database Design & Development Reference ID: BBBH77548 Jobseeker FAQs FAQ 1 Optional. Specifies the mode. Possible values: 0 – Default. Does not count all elements of multidimensional arrays 1 – Counts the array recursively (counts all the elements of multidimensional arrays) Optional. Specifies the mode. Possible values: Optional. Specifies the mode. Possible values: 0 – Default. Does not count all elements of multidimensional arrays 1 – Counts the array recursively (counts all the elements of multidimensional arrays)
