This insurance firm is actively seeking a highly skilled Data Engineer to join their Data and Analytics team. The ideal candidate is adept at creating and optimizing data systems and has a strong background in data pipeline development and data wrangling.

If you thrive in a collaborative environment and have a passion for data, this is the perfect opportunity for you!

Key Responsibilities:

• Design, develop, and monitor data ingestion pipelines from various sources.
• Continuously improve and optimize existing data pipelines for performance and scalability.
• Model data from API outputs into a relational format.
• Develop CI/CD pipelines using GitHub Actions.
• Provide support to ensure secure access to data for necessary teams and meet data quality and governance requirements.

Essential skills:

• Proven background with data engineering and development
• Experience with Azure Data Factory, Azure Databricks and/or Synapse Analytics, Azure Event Hubs
• Knowledge of Medallion Architecture/ Lakehouse/Data Warehouse in Fabric
• Experience in building data ingestion pipelines in Fabric
• Experience in Infrastructure-As-Code tools such as Terraform
• Experience in data architecture, data modelling, Data warehousing and SDLC
• Advanced SQL experience
• Experience with cloud storage concepts (e.g., Azure Blob Storage)
• Use Microsoft DevOps (CI/CD) to deploy new pipelines or implement changes to existing ones.
• Expertise in SQL and Python scripting
• Experienced with Docker/containerization
• Experience with visualisation tools such as Power BI
• Excellent communication skills with the ability to work effectively with a range of stakeholders
• Have a deep understanding of IaaS and PaaS services offered on the various cloud platforms and understand how to use them together to build complex solutions.
• Ability to work independently and effectively within a team environment.
• Any experience working in the Insurance domain will be highly desirable.

The client offers a 2 day in office / 3 day from home hybrid working model.

By clicking 'apply', you give your express consent that Robert Half may use your personal information to process your job application and to contact you from time to time for future employment opportunities. For further information on how Robert Half processes your personal information and how to access and correct your information, please read the Robert Half privacy notice: https://www.roberthalf.com/au/en/privacy. Please do not submit any sensitive personal data to us in your resume (such as government ID numbers, ethnicity, gender, religion, marital status or trade union membership) as we do not collect your sensitive personal data at this time.