Logo for Lead Data Engineer - Big Data, Python, AWS

Lead Data Engineer - Big Data, Python, AWS

Robert Walters
Sydney, NSW
A$190,000-$210,000 p/a
Information & Communication Technology → Database Development & Administration
Full-time
Hybrid

Posted 1 day ago


  • Permanent position, hybrid working arrangements
  • Big Data, Kafka, AWS, Python/PySpark, ETL
  • Hands-on role where you will oversee the design, development, and maintenance of their data infrastructure

Key Responsibilities

  • Lead the design, development, and implementation of scalable and robust data pipelines, ETL processes.
  • Oversee the maintenance and optimisation of our data warehouse and data lake.
  • Manage data platform governance, data modelling, and solution development.
  • Mentor and guide other data engineers, fostering a culture of continuous learning and improvement.
  • Contribute to the architecture and scaling of their data platform to support ever-growing data-intensive strategies

Key Requirements

  • 8+ years experience in data engineering within big data environments; Spark, Hadoop, Kafka
  • Strong, hands-on experience with designing and developing data platform solutions
  • Experience providing leadership for critical initiatives covering the end-to-end data development lifecycle
  • Strong experience engineering in cloud platforms; AWS/GCP
  • In-depth data platform infrastructure experience to enable the definition and measurement of non-functional requirements, such as reliability, availability, security, and performance

Hybrid working arrangements

Sydney, CBD 2000

Aboriginal and Torres Strait Islander Peoples are encouraged to apply.

To apply please click apply or call Christina Tran on 02 8289 3127 for a confidential discussion.


About Robert Walters

Burwood, VIC, Australia

This company does not have any further information provided at this time. We encourage you to research the company by searching for them to learn more about the company or role in question before applying.

Looking for More Opportunities?

Explore more jobs with upfront salary details that respect your worth.

Lead Data Engineer

u&u. Recruitment Partners

Logo for Lead Data Engineer
Sydney, NSW
A$190,000-$210,000 p/a
Full-time
On-site

Lead Data Engineer

Talenza

Sydney, NSW
A$170,000-$180,000 p/a
Full-time
Hybrid

Senior Data Engineer

The Onset

Logo for Senior Data Engineer
Sydney, NSW
A$170,000-$180,000 p/a
Full-time
Hybrid

Senior Data Engineer

Premier’s Department – MyCareer

Logo for Senior Data Engineer
Sydney, NSW
A$125,693-$138,510 p/a
Full-time
Hybrid

Data Engineer

Hydrogen Group Pty Ltd

Logo for Data Engineer
Sydney, NSW
A$150,000-$160,000 p/a
Full-time
On-site

Data & AI Consultant - Multiple Positions

Akkodis

Logo for Data & AI Consultant - Multiple Positions
Sydney, NSW
A$80-$140 p/h
Full-time
On-site

Principal Data Engineer - Leading Australian FinTech

Limelight People

Logo for Principal Data Engineer - Leading Australian FinTech
Sydney, NSW
A$180,000 p/a
Full-time
Hybrid

Senior Data Engineer (Snowflake)

Robert Half

North Sydney, NSW
A$140,000-$160,000 p/a
Full-time
Hybrid