Logo for Lead Data Engineer

Lead Data Engineer

Talenza
Sydney, NSW
A$210,000-$230,000 p/a
Information & Communication Technology → Other
Full-time
On-site

Posted 12 days ago


Lead Data Engineer

Sydney, Australia

$230,000 (including Super) + Bonus

About the Role:

Join a high-performing Data Team at a leading financial services institution to lead regulatory initiatives and drive innovation in data engineering, utilizing AI and automation to enhance platform efficiency.

Key Responsibilities:

  • Lead the development and transformation of the regulatory reporting platform.
  • Collaborate across business and technical teams to deliver complex data solutions.
  • Implement and optimize data integration pipelines and data warehouse solutions.
  • Oversee the design and architecture of large-scale data solutions using AWS services.
  • Drive platform efficiency through automation and AI enhancements.
  • Ensure data governance and compliance with internal and external regulations.
  • Provide leadership and mentorship to data engineers, fostering a culture of innovation and excellence.

Required Skills and Experience:

  • Proficient in Spark, Hive, Presto, and big data storage formats (Parquet, ORC, Avro).
  • Experience with data pipeline orchestration tools such as Airflow.
  • Hands-on experience with data integration tools (Talend, DataStage, or Informatica).
  • Strong AWS experience, including EC2, S3, RDS, and EMR.
  • Expertise in data modeling techniques and data architecture best practices.
  • Knowledge of data lineage, technical metadata, data quality, and reconciliation processes.
  • Advanced skills in Spark SQL and Python for data automation.
  • Ability to tune and optimize data queries for performance.
  • Strong communication and negotiation skills.
  • Proven experience in leading cross-platform data solutions and complex projects.
  • Ability to mentor and lead technical teams.

If you feel you possess the relevant skills to the above, please respond with most updated CV!


About Talenza

Sydney, NSW, Australia

This company does not have any further information provided at this time. We encourage you to research the company by searching for them to learn more about the company or role in question before applying.

More Jobs

Data Engineering Manager

Talenza

Sydney, NSW
A$200,000 p/a
Full-time
On-site

Lead Engineer - Big Data

Experis AU

Sydney, NSW
A$95-$115 p/h
Contract
On-site

Lead Engineer - Big Data

Experis AU

Sydney, NSW
A$95-$115 p/h
Contract
On-site

Data Engineering Lead - AWS, Pyspark

FourQuarters Recruitment

Melbourne, VIC
A$200,000 p/a
Full-time
On-site

Senior Data Engineer

Talenza

Sydney, NSW
A$900-$970 p/d
Full-time
On-site

Lead Data Engineer

Paxus

Sydney, NSW
A$180,000-$200,000 p/a
Full-time
On-site

Browse Jobs

by State

by Classification