My client is looking for a Senior Data Engineer to join a high-impact program focused on enhancing firewall deployment capabilities across complex enterprise environments.
You will be working on an initiative involving millions of NetFlow records, transforming raw network data into actionable insights and deployment-ready formats. This will be a 6 month contract based in Sydney CBD.

Your Duties

• Design and build efficient ETL pipelines in MS SQL to process, transform, and summarise massive volumes of network flow data.
• Contextualise and structure data to support rule creation and object implementation by Python Developers.
• Enrich flows with CMDB, DNS, and VMware data to ensure firewall rules are accurately deployed across the right environments.
• Generate deployment feeds in JSON/CSV formats for CSM and APIC consumption.
• Track data lineage from raw flows to aggregated outputs for audit and traceability.
• Optimise performance of NetFlow tables through indexing, partitioning, and query tuning.
• Automate workflows using Tidal, including retries, alerts, and exception handling.

About you

• Expert-level MS SQL Server skills - T-SQL, window functions, indexing, partitioning, and performance tuning.
• Proven experience in ETL design for large-scale environments and data migration (on-prem to cloud or on-prem to on-prem).
• Strong understanding of data modelling and workflow automation.
• Experience producing controller-ready formats (JSON/CSV) for APIC and CSM.
• Collaborative mindset - able to work closely with developers, network engineers, and security teams.
• Experience with Dask/Spark

Nice to have

• Experience with Dask/Spark for prototyping and data lineage tooling.
• Experience with PowerBI or similar visualisation tooling

Please note, you must be an Australian Citizen/PR

If you are interested, apply now or email

If you wish to apply for this position, please submit your resume by clicking the 'Apply Now' button. For further information please contact Cevina Feng at Clicks IT Recruitment on +61 425 106 599.

At Clicks we embrace diversity, inclusion and equal opportunity. First Nations people are encouraged to apply.

We provide reasonable adjustments, including alternate formats to the recruitment process for individuals with a disability. If you require an adjustment to be made during the recruitment process, please call 1300 254 257 or email [email protected]