Talent.com
This job offer is not available in your country.
AWS Cloud Data Engineer

AWS Cloud Data Engineer

EPS ConsultantsSingapore, Singapore, SG
30+ days ago
Job type
  • Quick Apply
Job description

Job Title : AWS ETL Cloud Data Engineer

Job Overview :

The AWS Cloud Data Engineer will be responsible for designing, building, and maintaining scalable data pipelines and data infrastructure in the AWS cloud environment. This role requires expertise in AWS services, data modeling, ETL processes, and a keen understanding of best practices for data management and governance.

Key Responsibilities :

  • Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd parties – Spark / Python on Glue, Redshift, S3, Athena, RDS-PostgreSQL, Airflow, Lambda, DMS, Code Commit, Code Pipeline, Code build, etc.
  • Design and build production ETL data pipelines from ingestion to consumption within a big data architecture, using DMS, DataSync & Glue.
  • Understand the existing applications(including on-premise Cloudera Datalake) and infrastructure architecture.
  • Analyze, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services.
  • Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
  • Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
  • Collaborate with development, infrastructure and data center teams to define Continuous Integration and Continuous Delivery processes in accordance with industry standards.
  • Work on hybrid Datalake.
  • Work closely with multiple stakeholders to ensure high standards are maintained.

Requirements

Mandatory Skill-set

  • Bachelors Degree in Computer Science, Information Technology or other relevant fields
  • 5+ years of work experience with ETL, Data Modelling, Data Architecture to build Datalake. Proficient in ETL optimization, designing, coding, and tuning big data processes using Pyspark.
  • 3+ yrs of extensive experience in working on AWS platform using core services like AWS Athena, Glue Pyspark, Redshift, RDS-PostgreSQL, S3 & Airflow(for orchestration).
  • Good to have Skill-set :

    Fundamental of Insurance domain

    Functional knowledge on IFRS17

    Benefits

    14 days AL

    Company Insurance Benefits

    Create a job alert for this search

    Cloud Engineer • Singapore, Singapore, SG

    Related jobs
    • Promoted
    Cloud Engineer

    Cloud Engineer

    ViasatBatam, Kepulauan Riau, Indonesia
    At Viasat, we’re on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 30+ days ago
    Regional Sales Engineer - Cloud

    Regional Sales Engineer - Cloud

    CrowdStrike Singapore Pte. Ltd.Singapore, Central Singapore District, SG
    As a global leader in cybersecurity, CrowdStrike protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn’t changed — we’re here to stop breaches...Show moreLast updated: 27 days ago
    • Promoted
    QA Engineer (Malaysia-Remote)

    QA Engineer (Malaysia-Remote)

    MATRIXX SoftwareKulai, Johor, Malaysia
    We are looking for a QA Software Engineer to expand our R&D team in Malaysia.In this role, you will focus on ensuring the quality, reliability, and performance of our MATRIXX product and customer s...Show moreLast updated: 14 days ago
    Cloud Engineer (Azure Cloud)

    Cloud Engineer (Azure Cloud)

    Unison GroupSingapore, Singapore, SG
    Quick Apply
    Experience in azure cloud infrastructure.Implement and maintain hybrid cloud architectures.Monitor and optimize the cost and performance of cloud infrastructure. Plan and execute infrastructure chan...Show moreLast updated: 14 days ago
    • Promoted
    DevOps Engineer

    DevOps Engineer

    Seedify IncKulai, Malaysia
    Seedworld Studios is looking for an experienced AWS DevOps professional who can design and implement secure, scalable, and highly available cloud solutions. The ideal candidate will have hands-on ex...Show moreLast updated: 4 days ago
    • Promoted
    Data Analytics Lead

    Data Analytics Lead

    LearntasticKulai, Johor, Malaysia
    About Us : We are a fast-growing continuous education company with multiple brands in the e-learning and certification space. Our mission is to provide high-quality, accessible courses for profession...Show moreLast updated: 1 day ago
    • Promoted
    Facilities Engineer

    Facilities Engineer

    SupermicroKulai, Johor, Malaysia
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    Data Engineer

    Data Engineer

    Unison GroupSingapore, Singapore, SG
    Quick Apply
    We are looking for a highly motivated and skilled.Build and maintain robust, scalable ETL pipelines across batch and real-time data sources. Design and implement data transformations using Spark (Py...Show moreLast updated: 18 days ago
    • Promoted
    Data Engineer

    Data Engineer

    Fairview International SchoolGelang Patah, Malaysia
    We are a digital health therapeutics company operating across SEA, focused on the intersection of mental health and physical chronic diseases. We combine behavioral science, psychology, data science...Show moreLast updated: 4 days ago
    • Promoted
    Facilities Engineer

    Facilities Engineer

    Super Micro Computer Spain, S.L.Kulai, Johor, Malaysia
    Supermicro is a Top Tier provider of advanced server, storage, and networking solutions for Data Center, Cloud Computing, Enterprise IT, Hadoop / Big Data, Hyperscale, HPC and IoT / Embedded customers...Show moreLast updated: 30+ days ago
    • Promoted
    Cloud Engineer

    Cloud Engineer

    RigNetBatam, Kepulauan Riau, Indonesia
    At Viasat, we’re on a mission to deliver connections with the capacity to change the world.For more than 35 years, Viasat has helped shape how consumers, businesses, governments and militaries arou...Show moreLast updated: 30+ days ago
    Azure Cloud Engineer

    Azure Cloud Engineer

    Unison GroupSingapore, Singapore, SG
    Quick Apply
    Move to Cloud (On-Prem to Azure).Implement and maintain hybrid cloud architectures.Git, Bash, Terraform, Python, PowerShell) for infrastructure management and automation. Strong understanding of mul...Show moreLast updated: 17 days ago
    • Promoted
    Senior Business Analyst - Insurance, Cantonese Speaker (Fully Remote)

    Senior Business Analyst - Insurance, Cantonese Speaker (Fully Remote)

    CoverGoKulai, Johor, Malaysia
    Working on the latest tech for the Insurtech Market Leader.At CoverGo, our mission is to empower all insurance companies to make insurance 100% digital and accessible to everyone.We are a leading g...Show moreLast updated: 18 days ago
    Cloud Data Engineer

    Cloud Data Engineer

    Unison GroupSingapore, Singapore, SG
    Quick Apply
    Design and architect data storage solutions, including databases, data lakes, and warehouses, using AWS services such as Amazon S3, Amazon RDS, Amazon Redshift, and Amazon DynamoDB, along with Data...Show moreLast updated: 18 days ago
    Cloud Engineer

    Cloud Engineer

    Unison GroupSingapore, Singapore, SG
    Quick Apply
    Cloud Operations, Move to Cloud (On-Prem to Azure), AFS, Resource Groups, Terraform.Experience in azure cloud infrastructure. Implement and maintain hybrid cloud architectures.Monitor and optimize t...Show moreLast updated: 18 days ago
    Infrastructure Cloud Engineer - Terraform

    Infrastructure Cloud Engineer - Terraform

    Unison GroupSingapore, Singapore, SG
    Quick Apply
    The ideal candidate will have hands-on experience in.Databricks workspace setup on AWS.This role involves designing, deploying, and maintaining cloud infrastructure using Infrastructure as Code (Ia...Show moreLast updated: 18 days ago
    • Promoted
    Senior Client Success Manager Inbound Leads

    Senior Client Success Manager Inbound Leads

    Fintech News Malaysia - part of Fintech News NetworkKulai, Johor, Malaysia
    Senior Client Success Manager Inbound Leads.Direct message the job poster from Fintech News Malaysia - part of Fintech News Network. Interested in the Fintech industry? Are you a great sales and mar...Show moreLast updated: 1 day ago
    • Promoted
    Technical Marketing Engineer

    Technical Marketing Engineer

    Infotree Global SolutionsKulai, Johor, Malaysia
    Job title : Developer : Technical Marketing - III.Max salary budget : RM8,000 / month.Experience : 5+ years in technical roles, 2+ years with developers, coding skills, and hands-on AI / edge / IoT experienc...Show moreLast updated: 16 days ago