Using the Talend ETL toolset, to create new and maintain existing ETL jobs.
Design and implement ETL for extracting and transforming data from diverse sources, such as : Hive, PostgreSQL, and SQL Server databases.
Design and develop database tables necessary along with the necessary constraints as per the requirement.
Collaborate with Team members to understand source system structures and data retrieval methods / techniques, and tools within the organization.
Support the development of data transformation logic using ETL tools or scripting languages like SQL, Python, etc.
Clean, validate, and transform data to confirm target schema and quality standards.
Work with the Team to execute data quality improvement plans.
Participate in troubleshooting activities to maintain data integrity and process efficiency.
Required skills
Experience with Talend, Python and Spark
Should have good knowledge and working experience in Datalake and Hadoop (Hive, Impala, HDFS).
Hands-on experience in designing, developing, and optimizing Talend Big Data jobs leveraging the Spark engine
Good understanding of Spark Catalyst Optimizer and spark executer parameters to optimize the Spark queries
Strong experience in data-warehousing and data-modeling techniques
Knowledge of industry-wide visualization and analytics tools
Good interpersonal skills and positive attitude
Create a job alert for this search
Developer • Singapore, Singapore
Related jobs
Promoted
Big Data Developer (Fully remote, established business, flat team structure)
DADACONSULTANTS PTE. LTD.Islandwide, SG
Remote
It is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services.
The platform offers a wide range of services, including spot trading, ...Show moreLast updated: 12 days ago
Promoted
Big Data Engineer (Contract) - QUESS SELECTION & SERVICES PTE. LTD.
Develop and maintain large-scale distributed systems using Hadoop ecosystem technologies such as HDFS, MapReduce, Cloudera Hive, Sqoop, and Impala.
Implement and optimize data pipelines using Apache...Show moreLast updated: 14 days ago
Study, evaluate, understand and provide feedback on functional specifications.Develop solutions following defined standards and high quality.
Provide detailed estimation for development of solutions...Show moreLast updated: 1 day ago
JONDAVIDSON PTE. LTD.D12 Balestier, Serangoon, Toa Payoh, SG
Minimum 3 - 4 years of experience.Must have knowledge in Spark & Hadoop.Having Banking knowledge is added advantage.Writing scalable, robust, testable, efficient and easily maintainable code.Tr...Show moreLast updated: 23 hours ago
Promoted
Big Data Engineer - DCS CARD CENTRE PTE. LTD.
DCS CARD CENTRE PTE. LTD.D07 Golden Mile, Middle Road, SG
Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation ...Show moreLast updated: 13 days ago
Develop and maintain large-scale distributed systems using Hadoop ecosystem technologies such as HDFS, MapReduce, Cloudera Hive, Sqoop, and Impala.
Implement and optimize data pipelines using Apache...Show moreLast updated: 14 days ago
Promoted
Data Engineer - Big Data - D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG
SYNAPXE PTE. LTD.D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG
Work with stakeholders to understand data analytics needs, data structure requirements (both in terms of scalability and accessibility), and translate this into a coherent near to long term data st...Show moreLast updated: 23 hours ago
Promoted
Big Data Developer (Fully remote, established business, flat team structure) - DADACONSULTANTS PTE. LTD.
DADACONSULTANTS PTE. LTD.Islandwide, SG
Remote
It is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services.
The platform offers a wide range of services, including spot trading, ...Show moreLast updated: 12 days ago
Promoted
Data Engineer - Big Data
SYNAPXE PTE. LTD.D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG
Work with stakeholders to understand data analytics needs, data structure requirements (both in terms of scalability and accessibility), and translate this into a coherent near to long term data st...Show moreLast updated: 23 hours ago
Promoted
Big Data Engineer - D07 Golden Mile, Middle Road, SG
DCS CARD CENTRE PTE. LTD.D07 Golden Mile, Middle Road, SG
Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation ...Show moreLast updated: 13 days ago
Promoted
Data Engineer - Big Data - SYNAPXE PTE. LTD.
SYNAPXE PTE. LTD.D05 Clementi New Town, Hong Leong Garden, Pasir Panjang, SG
Work with stakeholders to understand data analytics needs, data structure requirements (both in terms of scalability and accessibility), and translate this into a coherent near to long term data st...Show moreLast updated: 23 hours ago
JONDAVIDSON PTE. LTD.D12 Balestier, Serangoon, Toa Payoh, SG
Minimum 3 - 4 years of experience.Must have knowledge in Spark & Hadoop.Having Banking knowledge is added advantage.Writing scalable, robust, testable, efficient and easily maintainable code.Tr...Show moreLast updated: 23 hours ago
Promoted
Big Data Developer (Contract) - D01 Cecil, Marina, People’s Park, Raffles Place, SG
Study, evaluate, understand and provide feedback on functional specifications.Develop solutions following defined standards and high quality.
Provide detailed estimation for development of solutions...Show moreLast updated: 1 day ago
Promoted
Big Data Developer (Contract) - LINKS HR SINGAPORE PTE. LTD.
Study, evaluate, understand and provide feedback on functional specifications.Develop solutions following defined standards and high quality.
Provide detailed estimation for development of solutions...Show moreLast updated: 1 day ago
Promoted
Big Data Engineer
DCS CARD CENTRE PTE. LTD.D07 Golden Mile, Middle Road, SG
Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation ...Show moreLast updated: 13 days ago
Promoted
Bigdata / Hadoop Developer
JONDAVIDSON PTE. LTD.D12 Balestier, Serangoon, Toa Payoh, SG
Minimum 3 - 4 years of experience.Must have knowledge in Spark & Hadoop.Having Banking knowledge is added advantage.Writing scalable, robust, testable, efficient and easily maintainable code.Tr...Show moreLast updated: 23 hours ago
Promoted
Big Data Developer (Fully remote, established business, flat team structure) - Islandwide, SG
DADACONSULTANTS PTE. LTD.Islandwide, SG
Remote
It is a global cryptocurrency exchange dedicated to providing secure, efficient, and innovative digital asset trading services.
The platform offers a wide range of services, including spot trading, ...Show moreLast updated: 12 days ago
Promoted
Big Data Engineer, Data Ingestion - BYTEDANCE PTE. LTD.
BYTEDANCE PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life.With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to ...Show moreLast updated: 23 hours ago
Develop and maintain large-scale distributed systems using Hadoop ecosystem technologies such as HDFS, MapReduce, Cloudera Hive, Sqoop, and Impala.
Implement and optimize data pipelines using Apache...Show moreLast updated: 14 days ago
Promoted
Big Data Engineer, Data Ingestion - D01 Cecil, Marina, People’s Park, Raffles Place, SG
BYTEDANCE PTE. LTD.D01 Cecil, Marina, People’s Park, Raffles Place, SG
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life.With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to ...Show moreLast updated: 23 hours ago