Urgent requirement of Senior Data Engineer - Contract - Sydney Requirements Must have proficiency with AWS SageMaker Unified Studio, including its various components Discover, Build and Govern Experience with development in Sagemaker IDE and Application Jupyterlab, Spaces and Partner AI Apps Data Analysis and Integrations, Query Editor, Visual ETL Jobs and Data Processing jobs Orchestration of workflows and ML Pipelines Understanding and expertise to work with ML and Gen AI tools available in unified studio are ad-on values Setting up projects and data governance in SageMaker Unified studio Framework Development: Proven ability to design, develop, and implement highly reusable and adaptable data ingestion frameworks capable of handling diverse source types Key Skillset : Previous experience in developing framework for batch and real time data ingestions in relation and no-sql databases or filesystems Previous experience in Real time data ingestion with low latency with experience on AWS Kinesis Stream, Apache Kafka or similar streaming technologies Proven experience in various database technologies (e.g. Oracle, Teradata, MongoDB, Snowflake etc) Sound knowledge and experience in building Data Warehouses and Data Lakehouses Data Modeling experience is a plus point Duration: 6 Months and possible extension Eligibility: Australian/NZ Citizens/PR Holders only Email: jobs@hasthasolutions.com
