Logo for Lead Big Data Engineer

Lead Big Data Engineer

Paxus
Sydney, NSW
A$800-$900 p/d
Information & Communication Technology → Consultants
Full-time
Hybrid

Posted 3 days ago


We are seeking a highly skilled Lead Engineer - Big Data to join our team and work on a cutting-edge data platform. This role requires hands-on experience in designing and developing scalable data solutions, implementing modern data architectures, and leading data projects in a complex enterprise environment.

Key Responsibilities
  • Design, develop, test, and support future-ready data solutions across industry verticals.
  • Produce detailed solution designs and provide technical leadership for data engineers and testers.
  • Develop and support end-to-end batch and near real-time data pipelines.
  • Apply expertise in big data architectures, cloud platforms, AI/ML, analytics, and data governance.
  • Develop Proof of Concepts (PoCs) and Working Demos to showcase innovative solutions.
  • Collaborate with internal and external stakeholders on consulting, workshops, and delivery engagements.
  • Mentor junior engineers and consultants.
Mandatory Requirements
  • Proven leadership experience in project teams.
  • Ability to navigate large enterprise governance and processes.
  • Strong interpersonal and presentation skills for large technical forums.
  • 5+ years of experience in solution design, technical leadership, development, testing, or support roles in IT consulting (Banking/FSS preferred).
  • 3+ years of hands-on experience with Big Data/Data Lake services (cloud and on-premise).
  • Expertise in NoSQL databases (HBase) and Apache Kafka for real-time data streaming.
  • Strong understanding of data modeling (ER modeling, Third Normal Form, Dimensional Modeling).
  • Knowledge of Data Mesh Architecture and Domain Data Products.
  • Hands-on experience in Scala (Expert), Python, SQL, and shell scripting.
  • Expertise in cloud platforms such as Azure, AWS, GCP, and IBM Cloud.
  • Experience in ETL, Data Warehousing, BI solutions, and high-performance system implementations.

To be considered for the role click the 'apply' button or for more information about this and other opportunities please contact Yash Kumar Jain on [email protected] and quote the above job reference number.

Paxus values diversity and welcomes applications from Indigenous Australians, people from diverse cultural and linguistic backgrounds and people living with a disability. If you require an adjustment to the recruitment process, including the application form in an alternate format, please contact me on the above contact details.


About Paxus

Sydney, NSW, Australia

This company does not have any further information provided at this time. We encourage you to research the company by searching for them to learn more about the company or role in question before applying.

Looking for More Opportunities?

Explore more jobs with upfront salary details that respect your worth.

Data Pipeline Engineer

Bluefin Resources Pty Limited

Sydney, NSW
A$950-$1,050 p/d
Contract
Hybrid

Lead Data Engineer (s)

Recruitment Hive

Surry Hills, NSW
A$1,100 p/d
Contract
On-site

Principal Data Engineer

Edison Talent

Fortitude Valley, QLD
A$900-$1,200 p/d
Contract
Hybrid

Data Engineer

Talenza

Sydney, NSW
A$750-$850 p/d
Full-time
Hybrid

Data Engineer

Randstad Digital

Melbourne, VIC
A$950-$1,150 p/d
Full-time
Hybrid

Data Engineer

Bluefin Resources Pty Limited

Sydney, NSW
A$950-$1,050 p/d
Contract
Hybrid