Big Data Engineer (Contract) - Islandwide, SG

Roles & Responsibilities

Key Responsibilities :

• Develop and maintain large-scale distributed systems using Hadoop ecosystem technologies such as HDFS, MapReduce, Cloudera Hive, Sqoop, and Impala.
• Implement and optimize data pipelines using Apache Spark to handle large data sets efficiently.
• Perform ETL processes to move data between systems, using tools like Sqoop and custom Shell Scripts.
• Collaborate with data scientists and analysts to integrate business intelligence tools such as Tableau for data visualization and reporting.
• Manage databases and data warehouses such as MySQL, Oracle, and Cloudera to ensure data integrity and availability.
• Utilize version control systems like Git and Bitbucket for code management and collaboration.
• Automate deployment and CI / CD pipelines with tools like Jenkins, Maven, and Autosys.
• Work closely with the development teams using Eclipse and IntelliJ for coding and debugging.
• Collaborate with cross-functional teams using tools such as Jira, Confluence, and ServiceNow to manage projects and incident reporting.
• Ensure data governance, security, and compliance with company policies and regulations.

Requirements :

Savita Rai

EA REG NO : R1873418

EA License No : 23C2060

Disclaimer : The company is committed to ensuring the privacy and security of your information. By submitting this form, you consent to the collection, processing, and retention of the information you provide. The data collected (which may include your contact details, educational background, work experience and skills) will be used solely for the purpose of evaluating your qualifications for the position you're applying for. Your data will be stored securely and retained for the duration necessary to fulfill our hiring process. If you are not selected for the position, your data will be kept on file for a limited period in case future opportunities arise. You have the right to access, correct, or delete your data at any time by contacting us at Quess Singapore | A Leading Staffing Services Provider in Singapore (quesscorp.sg)

Tell employers what skills you have

Version Control

Confluence

Apache Spark

Eclipse

Azure

Pipelines

Hadoop

MySQL

ETL

Data Governance

MapReduce

JIRA

Distributed Systems

Business Intelligence Tools

Debugging

Databases