Data Engineer
Yoda Tech Pte Ltd
Posted 17 hours ago
Data Engineer – Databricks | AWS | Azure
Location: Singapore – Onsite
Experience: 5+ Years
Job Summary
We are looking for a Data Engineer with 5+ years of experience in building scalable data solutions using Databricks, AWS, and Azure.
Key Responsibilities
Develop and maintain ETL/ELT pipelines using Databricks, PySpark, Python, and SQL.
Build Lakehouse/Medallion Architecture using Delta Lake.
Work with AWS services such as S3, Glue, Athena, Redshift and Azure services such as ADLS Gen2, ADF, and Synapse.
Develop batch and real-time data pipelines and optimize Spark workloads.
Implement data modelling, data quality, governance, and performance optimization.
Manage Databricks Jobs/Workflows and production pipelines.
Implement CI/CD using Git, Azure DevOps/GitHub.
Troubleshoot production issues and collaborate with architects and business teams.
Required Skills
Databricks | PySpark | Python | SQL | Apache Spark | Delta Lake | AWS | Azure | S3 | Glue | ADLS | ADF | Synapse | ETL/ELT | Data Modelling | CI/CD | Git
Preferred
Kafka/Spark Streaming, Airflow, Terraform, Docker, Unity Catalog, CDC, and cloud certifications.
Qualification: Bachelor's degree in Computer Science/IT/Engineering or related field.
Requirement: Strong production experience with Databricks and cloud data platforms; willing to work onsite in Singapore.
About Yoda Tech Pte Ltd
This company does not have any further information provided at this time. We encourage you to research the company by searching for them to learn more about the company or role in question before applying.