Data Engineer - SEDHA CONSULTING PTE. LTD.

Roles & Responsibilities

Responsibilities :

• Test and validate data pipelines for all new releases.
• Ensure data integrity and completeness after deployments.
• Debug and troubleshoot pipeline issues.
• Implement fixes and document root causes.
• Optimise pipeline performance and efficiency.
• Write clean, maintainable Python code with unit tests.
• Collaborate with data scientists, engineers, and stakeholders.
• Support AWS-based pipeline infrastructure (e.g., S3, Lambda, EC2, CloudWatch).

Requirements :

Tell employers what skills you have

Version Control

Troubleshooting

Big Data

Pipelines

Unit Testing

Hadoop

ETL

Data Quality

EC2

Data Engineering

Attention to Detail

Python

Data Science

Debugging

S3

Databases