Key responsibilities

Build an orchestration framework in AWS (Step Functions, EventBridge, Lambda) with error handling, scheduling, and re-runs

Develop complex Glue ETL jobs in PySpark and use DataBrew for cleansing, enrichment, and quality checks

Implement reconciliation and verification logic using Athena queries, QuickSight dashboards, and S3 artefacts

Design and maintain ingestion pipelines with Glue Crawlers, Lambda, and AWS DMS for database replication

Manage data movement across S3 zones (raw, processed, curated) with Glue Data Catalog for full traceability

Use GitHub and GitHub Actions for version control and CI/CD automation

Monitor, log, and troubleshoot with CloudWatch and X-Ray

Collaborate closely with business SMEs to resolve mapping, data quality, and migration issues

What we're looking for

Strong experience building AWS-native data pipelines (Glue, Step Functions, S3, Lambda)

PySpark expertise for large-scale ETL in AWS Glue

Strong SQL skills for reconciliation and validation work

Experience in large-scale data migrations, ideally in utilities, billing, or similarly complex domains

Familiarity with event-driven architectures and reconciliation frameworks

Good understanding of data quality, lineage, and audit requirements

Strong communicator comfortable working with both technical and business stakeholders

NB PLEASE NOTE: THIS POSITION REQUIRES AUSTRALIAN PR/CITIZENSHIP OR NEW ZEALAND CITIZENSHIP

YOU MUST BE LOCATED IN MELBOURNE - ONLY THOSE WHO MEET ABOVE CRITERIA WILL BE CONSIDERED