Roles & Responsibilities
Senior Data Engineer
Key Responsibilities :
- Redesign and implement data pipelines using AWS-managed components to improve scalability and performance.
- Strengthen and enhance existing pipelines with industry-standard tools and best practices.
- Establish monitoring and alerting systems to proactively detect pipeline irregularities.
- Troubleshoot, investigate, and resolve data pipeline issues efficiently.
- Build and maintain unit and integration tests to ensure pipeline reliability.
- Prepare clear and detailed documentation for pipeline architecture, operations, and maintenance.
Requirements :
A minimum of 3 years’ hands-on experience in data engineering, with proven ability to design and build ETL pipelines.Strong programming proficiency in Python and solid SQL expertise.Practical knowledge of Linux shell scripting.Experience with orchestration tools such as Apache Airflow or equivalent.Skilled in AWS services such as S3, Glue, EMR, Lambda, and Step Functions.Familiarity with AWS Batch, Athena, and file formats such as Parquet; experience with NoSQL databases and AWS OpenSearch is advantageous.Demonstrated success in project execution and technical solution delivery.Flexibility to work onsite at multiple premises when required by the project team.We offer a competitive remuneration package, inclusive of an attractive salary and benefits, to the right candidate. Interested applicants are invited to submit a detailed resume (in Microsoft Word format).
We thank all applicants for their interest, and regret that only shortlisted candidates will be notified.
Stephanie Ang l Educare Human Capital
Reg No. : R1331070 l EA No. : 02C4944
9 Little Road #02-01 Singapore 536985
https : / / ehc.sg /
Please note that the personal data you provided in your job application will be collected, used, and disclosed by Educare Human Capital to assess your suitability for employment and manage your application, including consideration for future opportunities.
Tell employers what skills you have
Airflow
Scalability
Pipelines
Scripting
ETL
Reliability
Data Engineering
EMR
SQL
Microsoft Word
Orchestration
S3
Apache
Databases
Linux
Human Capital