Logo for Data Engineer

Data Engineer

Hydrogen Group Pty Ltd
Sydney, NSW
A$150,000-$160,000 p/a + Super
Information & Communication Technology → Database Development & Administration
Full-time
On-site

Posted 16 days ago


The Client
My client is a leading financial organisation who are continuing their journey with multiple projects where they are looking for Data Engineers. This client is working on multiple projects which would give you an exciting opportunity to cutting edge Technology tools.

The Role
This role offers a great chance to join a team of Engineering Manager's, Data experts and Project Manager's working on cutting edge, highly complex ETL design and Big Data tools. The position will also give you the chance to gain exposure to a range of other languages/technologies.

The ideal candidate will have experience working on similar projects working heavily with Big Data Tools and ETL design.

The key responsibilities will include.

  • Create repeatable and reusable ingestion and curation code in accordance with the architecture
  • Populate Data Lake and Data model for new the sources that haven't been incorporated into big data ecosystem
  • Low level design implementing ETL processes/pipelines where required
  • Delivery of data curation Jobs, including development, testing and implementation using CI/CD framework
  • Ingest structured / unstructured data in Real time, Near real time or batch cadence into the AWS S3
  • Responsible for ensuring the production services are optimally configured and aligned to best practices to protect production data.

Candidate Profile
Looking for the following skills/experience.

  • Working experience with cloud platforms such as AWS & GCP
  • Strong experience with Python
  • Proven experience building data working with tools such as Spark and Kafka
  • Highly skilled in all aspects of SQL and PL/SQL
  • Low level design or reusable framework experience highly regarded
  • AWS: redshift, S3, lambda beneficial
  • Working experince with tools such as Snowflake or Databricks

What's on offer?
This is an excellent opportunity to work on a great contract where you will have access to market leading tools, expert colleagues and a modern working environment. This opportunity offers a competitive daily rate as well as other excellent benefits. If you are interested in this role, please press apply.

...


About Hydrogen Group Pty Ltd

Melbourne, VIC, Australia

This company does not have any further information provided at this time. We encourage you to research the company by searching for them to learn more about the company or role in question before applying.

Looking for More Opportunities?

Explore more jobs with upfront salary details that respect your worth.

Senior Data Engineer

Premier’s Department – MyCareer

Logo for Senior Data Engineer
Sydney, NSW
A$125,693-$138,510 p/a
Full-time
Hybrid

Lead Data Engineer - Big Data, Python, AWS

Robert Walters

Logo for Lead Data Engineer - Big Data, Python, AWS
Sydney, NSW
A$190,000-$210,000 p/a
Full-time
Hybrid

Data Engineer

Profusion PAC Pty Ltd

Sydney, NSW
A$140,000 p/a
Full-time
Hybrid

Data & AI Consultant - Multiple Positions

Akkodis

Logo for Data & AI Consultant - Multiple Positions
Sydney, NSW
A$80-$140 p/h
Full-time
On-site

Lead Data Engineer

u&u. Recruitment Partners

Logo for Lead Data Engineer
Sydney, NSW
A$190,000-$210,000 p/a
Full-time
On-site

Data Governance Engineer - Greenfield site - Sydney or Melbourne - $170,000

Tech & Data People

Sydney, NSW
A$170,000 p/a
Full-time
On-site

Senior Data Engineer Power BI

Fyndr Group

Surry Hills, NSW
A$900 p/d
Full-time
On-site

Senior Data Engineer (Snowflake)

Robert Half

North Sydney, NSW
A$140,000-$160,000 p/a
Full-time
Hybrid