This pay rate is inclusive of mandatory 25% casual loading

Our client is seeking a Data Engineer to join their ICT Digital Solutions team to focus on ensuring robust and effective data solutions for operational needs while collaborating with a large-scale ICT modernisation and transformation program.

In this role, you'll work closely with an experienced Data Engineer to design and implement best-practice data solutions that underpin critical IT systems. From contributing to data modelling and architectural design to ensuring the scalability, security, and integrity of data pipelines, your expertise will directly support the program's success and ongoing operational stability.

What you will do:

• Design, implement, and maintain robust, scalable, and secure data pipelines and architectures using Microsoft Fabric and related tools in hybrid cloud environments.
• Manage data ingestion, transformation, and storage processes within Fabric Lakehouses / Delta Lakes utilising PySpark, PySQL, and .delta format to optimize and maintain data availability for reporting and analytics
• Utilize advanced SQL development techniques for database management, integration, query optimization, and performance tuning.
• Monitor and troubleshoot data pipelines, resolving issues to ensure high availability, reliability, and performance.
• Collaborate with the program's Data Engineer to design, model, and implement best-practice data solutions, ensuring scalability, security, and alignment with program objectives.
• Facilitate the seamless transition of data solutions from the program to Business-as-Usual (BAU) operations, ensuring operational readiness and continuity.
• Implement data quality management techniques to identify and resolve issues, ensuring data integrity and compliance with governance standards.
• Prepare and normalize large data sets to support statistical and machine learning models, enabling advanced analytics and decision-making.
• Identify opportunities to enhance data analysis capabilities, including optimizing models and improving analytics workflows.
• Provide mentorship and training to team members on data engineering tools, techniques, and best practices.
• Create and maintain detailed technical documentation, including data architecture designs, operational processes, and troubleshooting guides.
• Implement and support DevOps practices for continuous integration, continuous delivery (CI/CD) to streamline data solution deployments and enhance platform reliability and agility.
• Familiarity with Data Modeling, including conceptual, logical, and physical designs to support scalable and efficient data solutions

What you'll bring to the role:

• Strong background in data engineering, including Azure Synapse, data lakes, and SQL-based tools (SSIS, SSRS).
• Analytical Skills: Skilled in preparing and transforming data to support advanced analytics, reporting, and machine learning models.
• Proven 3+ years of experience in data engineering, with expertise in Azure Synapse, data pipelines, data lake architectures, and SQL-based tools (SSIS, SSRS).
• Proven ability to design, implement, and manage scalable data solutions in hybrid cloud environments, including advanced data preparation and transformation techniques.
• Proficiency in building and managing data pipelines, ingestion, and transformation processes using Azure tools and frameworks.
• Strong SQL development skills, with experience in advanced database management and integration solutions.
• Familiarity with statistical and machine learning models, including the preparation, normalization, and optimization of large data sets.
• Solid understanding of data quality management techniques, including identifying and resolving issues to ensure reliable and accurate data.
• Microsoft Azure Data Engineer Associate or equivalent certification highly desirable. Additional certifications in SQL, data engineering, or related practices are a bonus.

HOW TO APPLY:

Please submit your resume for consideration via the appropriate link. A cover letter demonstrating your relevant experience may also be reviewed.

Should you wish to discuss, please contact Jemma Walker at [email protected] quoting reference number: 243418. Your interest will be treated in the strictest of confidence.