Data Engineer
UpperGround by Hudson - Projects & Transformation
Posted 5 days ago
This pay rate is inclusive of mandatory 25% casual loading
Looking for a highly skilled Data Engineer to join the Data Migration Project team.
This role is critical in designing, implementing, and optimising data pipelines for a large-scale data migration initiative.
The ideal candidate must have strong expertise in Azure Data Factory (ADF), ETL processes, SQL Server, and Azure Storage (Blob, ADLS Gen2).
Required Qualifications & Skills:
- Experience & Background - Essential
- 5-6 years of hands-on experience in data engineering, data migration, and ETL development.
- Strong background in Azure Data Factory (ADF) with expertise in:
- Pipeline planning, designing, execution, and monitoring
- Handling full and incremental loads
- Exception handling and performance tuning
- Data transformation and cleansing
- Experience with SQL Server, including database design, writing complex stored procedures, and performance optimisation.
- Technical Skills
- Strong expertise in Azure Data Factory (ADF) and its integration with other Azure services.
- Proficiency in SQL Server and data warehousing concepts.
- Hands-on experience in Azure Storage solutions (Blob, ADLS Gen2) for handling structured and unstructured data - Essential.
- Good understanding of ETL frameworks and data transformation techniques - Essential.
- Experience with pipeline scheduling, exception handling, and monitoring.
- Knowledge of Power BI or other data visualisation tools is an added advantage.
- Familiarity with Microsoft Fabric is a plus.
- Problem-Solving & Analytical Thinking
- Strong problem-solving skills to troubleshoot migration challenges.
- Ability to analyse large datasets and identify inconsistencies or performance bottlenecks.
- Experience in optimising SQL queries and ADF pipelines for better performance.
- Collaboration & Communication
- Ability to communicate effectively with technical and non-technical stakeholders.
- Experience working in cross-functional teams to align data migration activities with business goals.
- Strong documentation skills to maintain clear and comprehensive project records.
Preferred Qualifications (Good to Have):
- Experience with Microsoft Fabric for data integration and processing.
- Proficiency in Power BI or similar BI tools for reporting and visualisation.
- Knowledge of data governance and compliance standards in cloud environments.
- Familiarity with other Azure cloud services related to data engineering.
HOW TO APPLY:
Please submit your resume (in MS Word Format) for consideration via the link below. A cover letter demonstrating your relevant experience may also be reviewed.
Should you wish to discuss, please contact Judith Fernandes at [email protected] , quoting reference number 244002.
Your interest will be treated in the strictest of confidence.
About UpperGround by Hudson - Projects & Transformation
This company does not have any further information provided at this time. We encourage you to research the company by searching for them to learn more about the company or role in question before applying.
More Jobs
Senior Data Engineer
Bluefin Resources Pty Limited
Senior Data Engineer-Microsoft Data Platform
AAR Consulting Group P/L
Data Engineer - Baseline Cleared
The Aquarium
Data Engineer
Bluefin Resources Pty Limited
Data Engineer / Data Warehouse - ETL Developer (TSPV)
Karlka Recruiting Group
Data Engineer (SQL & Python ETL)
Recruitment Hive
Browse Jobs
by State
by Classification