Data Engineer

Roles & Responsibilities

Key Responsibilities

• Design, develop, and optimize ETL / ELT pipelines using AWS services (Glue, Athena, S3, Redshift, Iceberg).
• Implement monitoring and alerting mechanisms for data workflows to ensure reliability and timely issue resolution.
• Perform database and schema optimization for improved performance, scalability, and cost efficiency.
• Manage data validation, taxonomy updates, and metadata consistency across environments.
• Refactor, clean, and maintain data jobs, tables, and legacy pipelines to align with best practices.
• Oversee infrastructure upgrades, including EKS cluster updates and database cleanup activities.
• Automate job scheduling and parameterization for efficient data processing.
• Collaborate with cross-functional teams to integrate external datasets while ensuring compliance with data governance standards.

Required Skills

Nice to Have

Tell employers what skills you have

Scalability

Taxonomy

Data Modeling

Pipelines

Data Transformation

ETL

Data Quality

Data Governance

Reliability

SQL

Python

Cloud Services

Performance Tuning

Metadata

Cataloging

S3