Cloud Engineer - Islandwide, SG

Roles & Responsibilities

Role and Responsibilities

• Design, develop, and optimize ETL / ELT pipelines using Databricks (PySpark, Spark SQL, Delta Lake).
• Implement data ingestion, transformation, and cleansing workflows from multiple data sources (structured and unstructured).
• Collaborate with data architects and business teams to ensure data models support analytics and reporting requirements.
• Manage and monitor Databricks clusters, jobs, and workflows for performance and cost optimization.
• Integrate Databricks with cloud platforms (e.g., Azure Data Lake, AWS S3, Synapse, Redshift, Snowflake, etc.).
• Develop and maintain CI / CD pipelines for Databricks notebooks and data workflows.
• Ensure compliance with data governance, security, and privacy standards.
• Troubleshoot and resolve issues in data pipelines and analytics jobs.
• Document technical solutions, data flows, and best practices.

Requirements :

Required Skills :

Preferred Skills :

Tell employers what skills you have

Machine Learning

Version Control

PySpark

Airflow

Apache Spark

Azure

Data Modeling

Pipelines

AWS

Azure Machine Learning

ETL

Databricks

Data Governance

Data Engineering

Python

GCP

Orchestration

S3

Power BI

Data Warehousing