Unlock your potential with a prestigious opportunity alongside an award-winning, data-driven industry leader! A tremendous opportunity awaits a Data Architect to collaborate a highly respected team. The successful candidate will play a pivotal role in building and maintaining robust, scalable, and high-performance data solutions that support our business’s strategic objectives. 9 months contract with a view to extend on Sydney’s north shore. Responsibilities: – Develop and maintain the organization’s Databricks-based data architecture by understanding business needs, current systems, and data movements. – Collaborate with stakeholders, data engineers, and business analysts to gather requirements and translate them into technical solutions on the Databricks platform. – Design and implement scalable data models, data pipelines, and ETL processes using Databricks to support various analytical and operational requirements. – Optimize and maintain the performance and stability of data solutions on the Databricks platform, ensuring reliability, efficiency, and security. – Provide expertise in Databricks best practices, configuration, and tuning to maximize the platform’s capabilities and benefits. – Lead and mentor a team of data engineers, providing guidance and knowledge transfer on Databricks architecture and development best practices. – Stay current with industry trends, emerging technologies, and best practices in data engineering and architecture, and leverage this knowledge to continually improve our data solutions. Ideally you will have: – Bachelor’s degree in computer science, information technology, or a related field. A Master’s degree is a plus. – Proven experience as a Data Architect, including at least 3 years of hands-on experience with Databricks architecture and development. – Expertise in building and optimizing data pipelines and ETL processes using Databricks, Apache Spark, and related technologies. – Strong understanding of cloud-based data platforms, particularly Azure, and proficiency in leveraging Databricks in these environments. – In-depth knowledge of big data technologies, data warehousing, and data modeling concepts, as well as experience with structured and unstructured data formats. – Proficiency in programming and scripting languages such as Python, SQL, Scala, or Java, with a focus on data manipulation and processing. – Experience in Azure data factory and Power BI also preferred. – Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and convey complex technical concepts to non-technical stakeholders. – Proven leadership and mentoring skills, with the ability to guide and develop a team of data engineers in implementing Databricks data solutions. Mane Consulting specialise in Data & Analytics. For more information on this role or others like this in the market apply below or contact Mark.cornwel-smith @mane.com.au
