Data Engineer

Roles & Responsibilities

Key Responsibilities

• Design, build, and maintain reliable data pipelines and data-processing workflows.

• Integrate data from APIs, databases, enterprise applications, cloud services, files, and other source systems.

• Develop scalable solutions for data ingestion, transformation, storage, processing, and serving.

• Support data platforms operating across cloud, on-premise, or hybrid environments.

• Implement appropriate monitoring, data-quality checks, error handling, and operational controls.

• Automate deployment and operational processes using CI/CD and Infrastructure as Code where applicable.

• Support production systems, troubleshoot issues, and contribute to root-cause analysis and continuous improvements.

• Work closely with application, infrastructure, platform, security, and business teams to deliver reliable data solutions.

• Maintain relevant technical documentation, operational procedures, and engineering standards.

Requirements

• Around 4–7 years or more of relevant experience in Data Engineering, Cloud Engineering, Platform Engineering, DevOps, SRE, or a related technical discipline.

• Hands-on experience designing, building, or operating production-grade data solutions.

• Experience with cloud platforms such as AWS and/or Azure.

• Experience with some of the following areas:

  • Python and SQL

  • ETL / ELT and data pipelines

  • Batch, streaming, CDC, or event-driven processing

  • Data modelling and data quality

  • Cloud data platforms and services

  • Logging, monitoring, telemetry, or observability

  • CI/CD and Infrastructure as Code

  • Docker or containerised environments

• Good understanding of software engineering practices, system reliability, scalability, security, and production support.

• Strong problem-solving skills and the ability to work across technical teams.

Good to Have

• Experience working across on-premise and cloud environments.

• Experience with streaming or messaging technologies such as Kafka or MQ.

• Experience with Terraform, Ansible, or equivalent automation tools.

• Familiarity with observability or monitoring platforms such as Grafana, Prometheus, Dynatrace, Elastic, or equivalent.

• Experience working in large-scale enterprise or Government environments.

• AWS or Azure certifications.

Tell employers what skills you have

Data Ingestion
Design
Construction
implementing monitoring tools
Data Pipeline
Database Systems
Root Cause Analysis
cloud hosting platform
Data Management Services
Enterprise Applications
Liaise With Technical Teams
Cloud-Based Platform
Cloud Services
Therapeutic Areas
Deployment Automation
software-engineering concepts