Data Engineer

Roles & Responsibilities

Responsibilities :

• Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.
• Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
• Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
• Contribute to common frameworks and best practices in code development, deployment, and automation / orchestration of data pipelines.
• Implement data governance in line with company standards.
• Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalising analytic pipelines.
• Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Databricks, others).
• Monitor data pipelines and data systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling mechanisms to ensure data integrity and system reliability.

Requirements

iKas International (Asia) Pte Ltd

“Sanderson-iKas” is the brand name for iKas International (Asia) Pte Ltd

EA Licence No : 16S8086 | EA Registration No. R1988468

We regret to inform you that only shortlisted candidates will be notified / contacted.

Tell employers what skills you have

Machine Learning

Git

PySpark

Airflow

Azure

Pipelines

Data Structures

Data Transformation

Software Engineering

Data Integration

Data Governance

Reliability

Data Engineering

SQL

Data Analytics

Databases