No longer accepting applications
Data Engineer
HORIZON COMPUTER MANAGEMENT PTE. LTD.Singapore, Singapore, Singapore18 days ago
Job descriptionStrong expertise in data modeling (dimensional / star / snowflake schemas) and data normalization techniques . Proficient in ETL / ELT tools such as Apache NiFi, Talend, Informatica, SSIS, or Airbyte . Advanced knowledge of SQL and distributed computing concepts . Experience with data lake and warehouse technologies such as Snowflake, Redshift, BigQuery, Azure Synapse, or Databricks . Deep understanding of data partitioning, indexing, and query optimization . Hands-on experience with Hadoop ecosystem (HDFS, Hive, HBase, Oozie, Sqoop) . Proficiency in Apache Spark / PySpark for distributed data processing. Exposure to streaming frameworks like Kafka, Flink, or Kinesis . Familiarity with NoSQL databases such as MongoDB, Cassandra, or Elasticsearch . Knowledge of data versioning and catalog systems (e.g., Delta Lake, Apache Hudi, Iceberg, or AWS Glue Data Catalog). Strong programming skills in Python , Scala , or Java for data manipulation and ETL automation. Experience with API integration, REST / GraphQL, and data serialization formats (JSON, Parquet, Avro, ORC). Proficient in shell scripting, automation, and orchestration tools (Apache Airflow, Prefect, or Luigi). Expertise in at least one cloud ecosystem : Strong understanding of IAM, VPC, encryption, and data access policies within cloud environments. Implement and enforce data quality frameworks (DQ checks, profiling, validation rules) . Knowledge of metadata management, lineage tracking , and master data management (MDM) . Familiarity with role-based access control (RBAC) and data encryption mechanisms. Experience with machine learning data pipelines (ML Ops) or feature store management . Knowledge of containerization and orchestration tools (Docker, Kubernetes). Familiarity with CI / CD pipelines for data deployment. Exposure to business intelligence (BI) tools like Power BI, Tableau, or Looker for data delivery. Understanding of data mesh or domain-driven data architecture principles . Work closely with cross-functional teams to define data requirements and best practices. Mentor junior engineers and enforce coding and documentation standards . Provide technical input in data strategy, architecture reviews, and technology evaluations . Collaborate with security and compliance teams to ensure data integrity and protection. Bachelor’s or Master’s Degree in Computer Science, Data Engineering, Information Systems, or related field. 5–10 years of professional experience as a Data Engineer or similar role. Professional Certifications preferred :
Key Responsibilities
- Design, build, and maintain robust, scalable, and secure data pipelines for batch and real-time data processing.
- Develop and optimize ETL / ELT workflows to extract, transform, and load data from multiple sources.
- Architect and implement data warehouses, data lakes, and lakehouse solutions on cloud or on-prem platforms.
- Ensure data quality, lineage, governance, and versioning using metadata management tools.
- Collaborate with Data Scientists, Analysts, and Software Engineers to deliver reliable and accessible data solutions.
- Optimize SQL queries, data models, and storage layers for performance and cost efficiency.
- Develop and maintain automation scripts for data ingestion, transformation, and orchestration.
- Integrate and process large-scale data from APIs, flat files, streaming services, and legacy systems.
- Implement data security, access control, and compliance standards (GDPR, ISO 27001) .
- Monitor and troubleshoot data pipeline failures, latency, and performance bottlenecks .
Data Engineering & Architecture
Big Data & Distributed Systems
Programming & Automation
Cloud Platforms
AWS : S3, Redshift, Glue, EMR, Lambda, Athena, Kinesis
Azure : Data Factory, Synapse, Blob Storage, Databricks
GCP : BigQuery, Dataflow, Pub / Sub, Cloud Composer
Data Governance & Security
Preferred Skills
Leadership & Collaboration
Qualifications
AWS Certified Data Analytics / Big Data Specialty
Microsoft Certified : Azure Data Engineer Associate
Google Professional Data Engineer
Databricks Certified Data Engineer
#J-18808-Ljbffr
Create a job alert for this search
Data Engineer • Singapore, Singapore, Singapore
Related jobs%20PTE.%20LTD.)
- Promoted
Data Engineer - Azure
TECHCOM SOLUTIONS (SINGAPORE) PTE. LTD.Singapore, Singapore, Singapore Design and implement data storage solutions.Create and maintain data storage solutions including.Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
Design, implement, and maintain.Create d...Show moreLast updated: 14 days ago
- Promoted
Data Engineer
Optiver US LLCSingapore, Singapore, Singapore Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai.
Established in 1986, today we are...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
EgenTelangana, India We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
KplerSingapore, Singapore, Singapore At Kpler, we are dedicated to helping our clients navigate complex markets with ease.By simplifying global trade information and providing valuable insights, we empower organisations to make inform...Show moreLast updated: 18 days ago
- Promoted
Senior Data Engineer
ExperianTelangana, India Experian Consumer Services – Careers That Define “What’s the Next Big (Data) Thing” for Consumers?.What could be more exciting – personally and professionally – than being part of a “disruptive” bu...Show moreLast updated: 5 days ago
- Promoted
Snowflake Data Engineer
AnblicksTelangana, India Snowflake Data Engineer – Early Joiners Preferred.Hyderabad / Ahmedabad (Hybrid).Great Place to Work® Certified |.Snowflake Elite Partner (3 Years in a Row).
Early Joiners / Immediate Joiners (withi...Show moreLast updated: 5 days ago
- Promoted
Data Engineer
ValueLabsTelangana, India Design, develop, and maintain • •ETL / ELT data pipelines • • to ingest data from various sources, including databases and flat files, into our data warehouse.
Utilize AWS services such as • •AWS Lambda • •...Show moreLast updated: 13 days ago
- Promoted
Data Engineer
ConfidentialHyderabad / Secunderabad, Telangana, Nizamabad, Warangal Chubb is looking for Data Engineer to join our dynamic team and embark on a rewarding career journey.Liaising with coworkers and clients to elucidate the requirements for each task.Conceptualizing ...Show moreLast updated: 30+ days ago
- Promoted
Data Engineer (Commodities)
OptiverSingapore, Singapore, Singapore Optiver is a global market maker founded in Amsterdam, with offices worldwide.We provide liquidity to financial markets using our own capital, trading a wide range of products.In this role you’ll d...Show moreLast updated: 7 days ago
- Promoted
Data Engineer
VINOVA PTE. LTD.Singapore, Singapore, Singapore Design, develop, and maintain data pipelines and ETL processes using AWS services (Glue, Athena, S3, RDS).Work with data virtualisation tools like Denodo and develop VQL queries.Ingest and process ...Show moreLast updated: 9 days ago
- Promoted
Data Engineer
NearaSingapore, Singapore, Singapore Paradex isn’t just another decentralized exchange—it’s a Super App.We’ve combined three powerful financial primitives : Exchange, Asset Management, and Borrow / Lend Markets, all seamlessly composable...Show moreLast updated: 18 days ago
- Promoted
Lead Data Engineer
Accordion IndiaTelangana, India Accordion is a global private equity-focused financial consulting firm specializing in driving value creation through services rooted in Data & Analytics and powered by technology.Accordion works a...Show moreLast updated: 2 days ago
- Promoted
Data Engineer
MediumSingapore, Singapore, Singapore At Kpler, we are dedicated to helping our clients navigate complex markets with ease.By simplifying global trade information and providing valuable insights, we empower organisations to make inform...Show moreLast updated: 18 days ago
- Promoted
Data Engineer
COMBUILDER PTE LTDSingapore, Singapore, Singapore Design and implement enterprise-scale date architectures, including data lakes, warehouses, and real-time streaming platforms.
Develop and maintain ETL / ELT pipelines that efficiently process large v...Show moreLast updated: 10 days ago
- Promoted
Senior Data Engineer (AI)
JAC Recruitment Pte LtdSingapore, Singapore, Singapore My client is a Global Healthcare organisation and they are looking for a seasoned Senior Data Engineer to lead Snowflake-based data solutions supporting AI and analytics initiatives.This role focus...Show moreLast updated: 12 days ago
- Promoted
Data engineer - Azure
Flintex Consulting Pte LtdSingapore, Singapore, Singapore Synapse and Pyspark, Python, Datawarehouse and Power BI , Azure Devops.Bachelor’s Degree in Computer Science or Engineering with 3-5 years of experience in Azure Data engineering, Python, Pyspark o...Show moreLast updated: 12 days ago
- Promoted
Azure Data Architect
Programmers.ioTelangana, India, India Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced.
The ideal candidate should bring strong expertise in SQL, ETL / EL...Show moreLast updated: 3 days ago
- Promoted
Lead Data Engineer
AonSingapore, Singapore, Singapore Aon is in the business of better decisions.At Aon, we shape decisions for the better to protect and enrich the lives of people around the world.
As an organization, we are united through trust as on...Show moreLast updated: 18 days ago