Senior Data Engineer (AWS & Confluent Data / AI Projects) | Remote

TASQ Staffing SolutionsWorkFromHome, Singapore, Singapore

3 days ago

Job type

Remote

Job description

About the job Senior Data Engineer (AWS & Confluent Data / AI Projects) | Remote

Work Set-up : Remote

Schedule : 10am-6pm SGT

Responsibilities :

Architect and Design Data Solutions : Lead the design and architecture of scalable, secure, and efficient data pipelines for both batch and real-time data processing on AWS. This includes data ingestion, transformation, storage, and consumption layers.
Confluent Kafka Expertise : Design, implement, and optimize highly performant and reliable data streaming solutions using Confluent Platform (Kafka, ksqlDB, Kafka Connect, Schema Registry). Ensure efficient data flow for real-time analytics and AI applications.
AWS Cloud Native Development : Develop and deploy data solutions leveraging a wide range of AWS services, including but not limited to :

Data Storage : S3 (Data Lake), RDS, DynamoDB, Redshift, Lake Formation.

Data Processing : Glue, EMR (Spark), Lambda, Kinesis, MSK (for Kafka integration).

Orchestration : AWS Step Functions, Airflow (on EC2 or MWAA)

Analytics & ML : Athena, QuickSight, SageMaker (for MLOps integration).

Required Skills and Qualifications :

Bachelor's or Master's degree in Computer Science, Software Engineering, or a related quantitative field.

3 to 5 years of experience in data engineering, with a significant focus on cloud-based solutions.

Extensive hands‑on experience with Confluent Platform / Apache Kafka for building real‑time data streaming applications.

Proficiency in programming languages such as Python, PySpark, Scala, or Java.

Expertise in SQL and experience with various database systems (relational and NoSQL).

Solid understanding of data warehousing, data lakes, and data modeling concepts (star schema, snowflake schema, etc.).

Experience with CI / CD pipelines and DevOps practices (Git, Terraform, Jenkins, Azure DevOps, or similar).

Preferred Qualifications (Nice to Have) :

AWS Certifications (e.g., AWS Certified Data Analytics - Specialty, AWS Certified Solutions Architect - Associate / Professional).

Experience with other streaming technologies (e.g., Flink).

Knowledge of containerization technologies (Docker, Kubernetes).

Familiarity with Data Mesh or Data Fabric concepts.

Experience with data visualization tools (e.g., Tableau, Power BI, QuickSight).

Understanding of MLOps principles and tools.

#J-18808-Ljbffr

Create a job alert for this search

Senior Data Engineer • WorkFromHome, Singapore, Singapore

Related jobs

Promoted

Senior Data & AI Engineer

RANDSTAD PTE. LIMITEDD01 Cecil, Marina, People’s Park, Raffles Place, SG

Potential career advancement to become a Data Architect.Exposure to new AI project / environment.We are seeking a highly proactive, self-driven. APAC Subject Matter Expert (SME).This is a strategic ro...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer

OPENSOURCE PTE. LTD.Islandwide, SG

The Senior Data Engineer is responsible for designing, building, and maintaining large-scale, secure, and high-performance data pipelines supporting critical Financial Services workloads.The role f...Show moreLast updated: 12 days ago

Promoted

Data Engineer (AWS + Databricks + IDMC)

EXASOFT PTE. LTD.Islandwide, SG

Define, develop, and maintain blueprints, roadmaps, and reference architectures for data analytics infrastructure and services. Analyze new requirements, develop solutions, and manage solution del...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer / AWS Migration Lead _ Contract_Public Sector Project

NTT SINGAPORE PTE. LTD.D12 Balestier, Serangoon, Toa Payoh, SG

Confidential (Government Ministry).The project involves migrating existing data infrastructure and dashboards to the.AWS Data Analytics Platform (DAP). Senior Data Engineer / AWS Migration Lead.Shar...Show moreLast updated: 23 hours ago

Promoted

Data Engineer

ANTAS PTE. LTD.D07 Golden Mile, Middle Road, SG

POSITION OVERVIEW : Data Engineer.POSITION GENERAL DUTIES AND TASKS : .Minimum Relevant Experience : 5 Years.Key Skills : Sr Data Engineer with IDMC / Informatica skills. Design and architect data storag...Show moreLast updated: 1 day ago

Promoted

Confluent Engineer

ConfidentialSingapore

As a Confluent Consulting Engineer, you will be responsible for designing, developing, and maintaining scalable real-time data pipelines and integrations using Kafka and Confluent components.You wi...Show moreLast updated: 10 days ago

Promoted

Senior Data Engineer (Hive SQL, Hadoop, Cloudera)

NEPTUNEZ SINGAPORE PTE. LTD.Islandwide, SG

Migrate existing data warehouse and data model from MariaDB to Hadoop Big Data Cloudera on-premises platform.Develop and optimize SQL, Hive SQL, and Spark scripts to ensure efficient data processin...Show moreLast updated: 12 days ago

Promoted

Senior Data Engineer / AWS Migration Lead

RAPSYS TECHNOLOGIES PTE. LTD.Islandwide, SG

Migration & Technical Implementation : .Lead migration of on-premises and SharePoint-based data infrastructure to AWS Data Analytics Platform (DAP). Collaborate with AWS teams to develop comprehen...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

KPMG SERVICES PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG

KPMG is a global network of professional firms providing Audit, Tax and Advisory services.With 200,000 people operating in 154 countries around the world, we have outstanding professionals working ...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer (AWS Migration)

NSEARCH GLOBAL PTE. LTD.Islandwide, SG

Our client, one of Asia-Pacific’s leading organizations is looking for : .Lead migration of on-premises and SharePoint-based data infrastructure to AWS Data Analytics Platform (DAP).Collaborate with ...Show moreLast updated: 1 day ago

Promoted

Data Engineer (AWS)

HAYS SPECIALIST RECRUITMENT PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG

An IT solutions consultancy is looking for an experienced Data Engineer to join their team.Build and maintain scalable data systems including databases, warehouses, and processing architectures.Des...Show moreLast updated: 30+ days ago

Promoted

Data Engineer - AWS

RAPSYS TECHNOLOGIES PTE. LTD.Islandwide, SG

Promoted

Senior AI Engineer

ASIAPAC TECHNOLOGY PTE. LTD.D03 Queenstown, Tiong Bahru, SG

At AsiaPac Technology, we’re on a mission to shape the next generation of intelligent applications.We’re looking for a Full Stack AI Engineer who’s excited to bring bold ideas to life, blending cre...Show moreLast updated: 30+ days ago

Promoted

Data Engineer(AWS)

RAPSYS TECHNOLOGIES PTE. LTD.Islandwide, SG

Extensive experience with AWS services (SageMaker, QuickSight, Athena, Lambda, data pipelines).Experience using AWS services in Python and Command Line Interface. Proficiency in serverless architect...Show moreLast updated: 1 day ago

Promoted

Senior Data Engineer

IKAS INTERNATIONAL (ASIA) PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG

Join a high impact team helping solve critical data and infrastructure challenges.Contribute to shaping the consulting practice while delivering impactful, scalable solutions.Advise on data enginee...Show moreLast updated: 2 days ago

Promoted

Senior Data Engineer( Hive SQL, Hadoop, Cloudera)

EXASOFT PTE. LTD.Islandwide, SG

Promoted

Data Engineer (IDMC, AWS, Redshift, ETL, Databricks)

NEPTUNEZ SINGAPORE PTE. LTD.Islandwide, SG

Design, develop, and maintain scalable data pipelines and ETL / ELT processes for structured and unstructured data.Define and implement data models and warehouse architectures (star / snowflake schema)...Show moreLast updated: 12 days ago

Promoted
New!

Senior Data Engineer

MANPOWER STAFFING SERVICES (SINGAPORE) PTE LTDIslandwide, SG

Design, develop, and maintain scalable data pipelines to process and analyze data from multiple advertising platforms.Implement data models and ETL processes to support automated mon...Show moreLast updated: 6 hours ago