Talent.com
This job offer is not available in your country.
Big Data Developer

Big Data Developer

Zenith Infotech(s) Pte LtdSingapore, Singapore
30+ days ago
Job type
  • Quick Apply
Job description

Job Scope :

  • Using the Talend ETL toolset, to create new and maintain existing ETL jobs.
  • Design and implement ETL for extracting and transforming data from diverse sources, such as : Hive, PostgreSQL, and SQL Server databases.
  • Design and develop database tables necessary along with the necessary constraints as per the requirement.
  • Collaborate with Team members to understand source system structures and data retrieval methods / techniques, and tools within the organization.
  • Support the development of data transformation logic using ETL tools or scripting languages like SQL, Python, etc.
  • Clean, validate, and transform data to confirm target schema and quality standards.
  • Work with the Team to execute data quality improvement plans.

Participate in troubleshooting activities to maintain data integrity and process efficiency.

Required skills

  • Experience with Talend, Python and Spark
  • Should have good knowledge and working experience in Datalake and Hadoop (Hive, Impala, HDFS).
  • Hands-on experience in designing, developing, and optimizing Talend Big Data jobs leveraging the Spark engine
  • Good understanding of Spark Catalyst Optimizer and spark executer parameters to optimize the Spark queries
  • Strong experience in data-warehousing and data-modeling techniques
  • Knowledge of industry-wide visualization and analytics tools
  • Good interpersonal skills and positive attitude
  • Create a job alert for this search

    Developer • Singapore, Singapore

    Related jobs
    • Promoted
    Big Data Developer (Fully remote, established business, flat team structure)

    Big Data Developer (Fully remote, established business, flat team structure)

    DADACONSULTANTS PTE. LTD.Islandwide, SG
    Remote
    It is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, ...Show moreLast updated: 12 days ago
    • Promoted
    Big Data Engineer (Contract) - QUESS SELECTION & SERVICES PTE. LTD.

    Big Data Engineer (Contract) - QUESS SELECTION & SERVICES PTE. LTD.

    QUESS SELECTION & SERVICES PTE. LTD.Islandwide, SG
    Develop and maintain large-scale distributed systems using Hadoop ecosystem technologies such as HDFS, MapReduce, Cloudera Hive, Sqoop, and Impala. Implement and optimize data pipelines using Apache...Show moreLast updated: 14 days ago
    • Promoted
    Big Data Developer (Contract)

    Big Data Developer (Contract)

    LINKS HR SINGAPORE PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG
    Study, evaluate, understand and provide feedback on functional specifications.Develop solutions following defined standards and high quality. Provide detailed estimation for development of solutions...Show moreLast updated: 1 day ago
    • Promoted
    Bigdata / Hadoop Developer - D12 Balestier, Serangoon, Toa Payoh, SG

    Bigdata / Hadoop Developer - D12 Balestier, Serangoon, Toa Payoh, SG

    JONDAVIDSON PTE. LTD.D12 Balestier, Serangoon, Toa Payoh, SG
    Minimum 3 - 4 years of experience.Must have knowledge in Spark & Hadoop.Having Banking knowledge is added advantage.Writing scalable, robust, testable, efficient and easily maintainable code.Tr...Show moreLast updated: 23 hours ago
    • Promoted
    Big Data Engineer - DCS CARD CENTRE PTE. LTD.

    Big Data Engineer - DCS CARD CENTRE PTE. LTD.

    DCS CARD CENTRE PTE. LTD.D07 Golden Mile, Middle Road, SG
    Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation ...Show moreLast updated: 13 days ago
    • Promoted
    Big Data Engineer (Contract)

    Big Data Engineer (Contract)

    QUESS SELECTION & SERVICES PTE. LTD.Islandwide, SG
    Develop and maintain large-scale distributed systems using Hadoop ecosystem technologies such as HDFS, MapReduce, Cloudera Hive, Sqoop, and Impala. Implement and optimize data pipelines using Apache...Show moreLast updated: 14 days ago
    • Promoted
    Data Engineer - Big Data - D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG

    Data Engineer - Big Data - D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG

    SYNAPXE PTE. LTD.D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG
    Work with stakeholders to understand data analytics needs, data structure requirements (both in terms of scalability and accessibility), and translate this into a coherent near to long term data st...Show moreLast updated: 23 hours ago
    • Promoted
    Big Data Developer (Fully remote, established business, flat team structure) - DADACONSULTANTS PTE. LTD.

    Big Data Developer (Fully remote, established business, flat team structure) - DADACONSULTANTS PTE. LTD.

    DADACONSULTANTS PTE. LTD.Islandwide, SG
    Remote
    It is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, ...Show moreLast updated: 12 days ago
    • Promoted
    Data Engineer - Big Data

    Data Engineer - Big Data

    SYNAPXE PTE. LTD.D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG
    Work with stakeholders to understand data analytics needs, data structure requirements (both in terms of scalability and accessibility), and translate this into a coherent near to long term data st...Show moreLast updated: 23 hours ago
    • Promoted
    Big Data Engineer - D07 Golden Mile, Middle Road, SG

    Big Data Engineer - D07 Golden Mile, Middle Road, SG

    DCS CARD CENTRE PTE. LTD.D07 Golden Mile, Middle Road, SG
    Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation ...Show moreLast updated: 13 days ago
    • Promoted
    Data Engineer - Big Data - SYNAPXE PTE. LTD.

    Data Engineer - Big Data - SYNAPXE PTE. LTD.

    SYNAPXE PTE. LTD.D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG
    Work with stakeholders to understand data analytics needs, data structure requirements (both in terms of scalability and accessibility), and translate this into a coherent near to long term data st...Show moreLast updated: 23 hours ago
    • Promoted
    Bigdata / Hadoop Developer - JONDAVIDSON PTE. LTD.

    Bigdata / Hadoop Developer - JONDAVIDSON PTE. LTD.

    JONDAVIDSON PTE. LTD.D12 Balestier, Serangoon, Toa Payoh, SG
    Minimum 3 - 4 years of experience.Must have knowledge in Spark & Hadoop.Having Banking knowledge is added advantage.Writing scalable, robust, testable, efficient and easily maintainable code.Tr...Show moreLast updated: 23 hours ago
    • Promoted
    Big Data Developer (Contract) - D01 Cecil, Marina, People’s Park, Raffles Place, SG

    Big Data Developer (Contract) - D01 Cecil, Marina, People’s Park, Raffles Place, SG

    LINKS HR SINGAPORE PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG
    Study, evaluate, understand and provide feedback on functional specifications.Develop solutions following defined standards and high quality. Provide detailed estimation for development of solutions...Show moreLast updated: 1 day ago
    • Promoted
    Big Data Developer (Contract) - LINKS HR SINGAPORE PTE. LTD.

    Big Data Developer (Contract) - LINKS HR SINGAPORE PTE. LTD.

    LINKS HR SINGAPORE PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG
    Study, evaluate, understand and provide feedback on functional specifications.Develop solutions following defined standards and high quality. Provide detailed estimation for development of solutions...Show moreLast updated: 1 day ago
    • Promoted
    Big Data Engineer

    Big Data Engineer

    DCS CARD CENTRE PTE. LTD.D07 Golden Mile, Middle Road, SG
    Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation ...Show moreLast updated: 13 days ago
    • Promoted
    Bigdata / Hadoop Developer

    Bigdata / Hadoop Developer

    JONDAVIDSON PTE. LTD.D12 Balestier, Serangoon, Toa Payoh, SG
    Minimum 3 - 4 years of experience.Must have knowledge in Spark & Hadoop.Having Banking knowledge is added advantage.Writing scalable, robust, testable, efficient and easily maintainable code.Tr...Show moreLast updated: 23 hours ago
    • Promoted
    Big Data Developer (Fully remote, established business, flat team structure) - Islandwide, SG

    Big Data Developer (Fully remote, established business, flat team structure) - Islandwide, SG

    DADACONSULTANTS PTE. LTD.Islandwide, SG
    Remote
    It is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services. The platform offers a wide range of services, including spot trading, ...Show moreLast updated: 12 days ago
    • Promoted
    Big Data Engineer, Data Ingestion - BYTEDANCE PTE. LTD.

    Big Data Engineer, Data Ingestion - BYTEDANCE PTE. LTD.

    BYTEDANCE PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG
    Founded in 2012, ByteDance's mission is to inspire creativity and enrich life.With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to ...Show moreLast updated: 23 hours ago
    • Promoted
    Big Data Engineer (Contract) - Islandwide, SG

    Big Data Engineer (Contract) - Islandwide, SG

    QUESS SELECTION & SERVICES PTE. LTD.Islandwide, SG
    Develop and maintain large-scale distributed systems using Hadoop ecosystem technologies such as HDFS, MapReduce, Cloudera Hive, Sqoop, and Impala. Implement and optimize data pipelines using Apache...Show moreLast updated: 14 days ago
    • Promoted
    Big Data Engineer, Data Ingestion - D01 Cecil, Marina, People’s Park, Raffles Place, SG

    Big Data Engineer, Data Ingestion - D01 Cecil, Marina, People’s Park, Raffles Place, SG

    BYTEDANCE PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG
    Founded in 2012, ByteDance's mission is to inspire creativity and enrich life.With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to ...Show moreLast updated: 23 hours ago