Bluefin Resources is proud to partner with a prestigious government enterprise to recruit a Senior Data Engineer for a long-term contract with a strong likelihood of extension. This is an exciting opportunity for a highly skilled professional with deep expertise in the Microsoft Data Platform ecosystem to work with Microsoft Fabric.

Role
The ideal candidate will have extensive experience in designing, building, and maintaining robust data pipelines within the Microsoft Data Platform ecosystem. This role requires deep expertise in data ingestion, transformation, and processing using SSIS, Synapse Pipelines, and Spark, along with hands-on experience in master data management using Profisee.

As a Senior Data Engineer, you will play a key role in ensuring data quality, performance, and scalability across enterprise data solutions. Additionally, you will contribute to the development of Power BI reports within Microsoft Fabric, supporting data-driven decision-making across the organisation.

About the Team
The Data Analytics and Insights team plays a pivotal role in enabling data-driven decision-making across the organisation. We are a collaborative and forward-thinking group of data professionals, leveraging the Microsoft ecosystem to deliver impactful insights.

We are currently transitioning to a modern Lakehouse architecture using Synapse Analytics, while continuing to enhance our existing SQL-based Data Warehouse.

Key Responsibilities

• Design, develop, and maintain ETL/ELT pipelines for ingesting data from various source systems into our SQL Dedicated Pool and Synapse Lakehouse platforms.
• Develop and optimise data transformation logic using T-SQL and Spark (Python) within Synapse Pipelines.
• Develop Spark notebooks for complex data transformations and processing within the Synapse environment.
• Implement data quality checks and validation rules to ensure data accuracy and consistency.
• Build and deploy Synapse Pipelines for orchestrating data ingestion, transformation, and loading processes in Azure Synapse Analytics/ Microsoft Fabric
• Collaborate with data architects to implement and maintain the data model and metadata management.
• Work with Power BI developers to provide curated and performant datasets for reporting and analytics within Microsoft Fabric; also develop analytics reports if required
• Understand and implement medallion architecture principles (Bronze, Silver, Gold layers) within the data platforms.
• Participate in code reviews and contribute to team best practices
• Monitor and troubleshoot data pipeline performance and resolve data-related issues in non-production environments

Additional Responsibilities

• Stay up-to-date with the latest advancements in Microsoft data platform technologies, including Microsoft Fabric.
• Document data pipelines, data models, and other technical artefacts.
• Develop batch integration processes with Profisee for Master Data Management (MDM), including defining matching and survivorship rules for golden record creation when required.
• Contribute to the development and enforcement of data governance policies and standards.

Expected Experience

• Bachelor's degree in Computer Science, Information Systems, or a related field.
• 5+ years of experience in data engineering or a similar role.
• Strong understanding of data warehousing concepts, dimensional modeling, and ETL/ELT principles.
• Expertise in T-SQL and experience working with SQL Server and/or Azure Synapse Dedicated SQL Pools.
• Hands-on experience with Azure Synapse Analytics, including Synapse Pipelines and Spark Pools.
• Experience with Spark (Python) for data processing and transformation.
• Familiarity with Microsoft Fabric components (Data Factory, Synapse Data Engineering, Power BI).
• Experience with version control systems (e.g., Git Integrated Visual Studio and Azure DevOps).
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Experience

• Experience with Master Data Management (MDM) concepts and tools, preferably Profisee.
• Knowledge of data quality management and data governance best practices, preferably in Purview.
• Experience with Azure Data Lake Storage Gen2.
• Experience with CI/CD pipelines for data engineering.
• Experience with Agile development methodologies.
• Proficient in developing and deploying SSIS packages.

Certifications (Beneficial)

• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Certified: Fabric Data Engineer Associate
• Profisee certifications

What's Available:

This is an initial 6 month contract with a strong possibility of extension. The role offers flexible working options and is based in the Parramatta offices.

You'll be working alongside a team of dedicated professionals, contributing to a meaningful and high-impact project where your expertise will make a real difference.

To apply, please submit your updated resume online. For a more in-depth discussion, feel free to reach out to Lee Bartlett at 0410 744 438.