Job Description – Data Engineer (Scala & Apache Spark, ArangoDB)

�� Location: Melbourne (2 days on-site per week)
�� Contract: 6-month contract with a high chance of extension

We are seeking a skilled Data Engineer with expertise in Scala and Apache Spark to design, build, and optimize data pipelines. The ideal candidate will have a strong background in ETL processes, data engineering, and pipeline development, along with deep knowledge of ArangoDB and its query language (AQL). Certification in ArangoDB is highly preferred.

Key Responsibilities:

• Develop and maintain data pipelines using Scala and Apache Spark.
• Work with ArangoDB, optimizing queries and ensuring efficient data storage and retrieval.
• Design and implement ETL processes to support data integration and transformation.
• Collaborate with cross-functional teams to understand business needs and deliver scalable data solutions.
• Ensure data integrity, quality, and performance optimization.
• Troubleshoot issues and provide solutions to improve pipeline efficiency.
• Communicate effectively with stakeholders and contribute to team collaboration.

Key Requirements:

• Proven experience as a Data Engineer, particularly with Scala and Apache Spark.
• Strong knowledge of ArangoDB and AQL (certification preferred).
• Hands-on experience with ETL processes and data pipeline development.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.
• Ability to work both independently and within a team environment.

Summary:

This role is best suited for a Data Engineer with a focus on Scala, Apache Spark, and ArangoDB. Unlike other roles that emphasize cloud platforms (AWS/Azure) or broader programming stacks, this position is highly specialized in graph databases (ArangoDB) and big data processing (Apache Spark, Scala). The ideal candidate should have ETL and data pipeline expertise, with a preference for certified ArangoDB professionals. Strong problem-solving, communication, and teamwork skills are essential.