This job offer is not available in your country.

Data Engineer •Proficient in AWS (AMK) - Islandwide, SG

MAESTRO HUMAN RESOURCE PTE. LTD.Islandwide, SG

12 days ago

Job description

Roles & Responsibilities

Job Description & Requirements

We are looking for aspiring Data Engineer / Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approach to consolidate data from various sources and systems.

About the Role

Collaborating with a team of highly skilled Software Engineers and Data Engineers in deploying and delivering software products.Actively participating in product enhancement, particularly in the areas of integration and UI, to improve product quality and reconfigurability.
Taking ownership of the development of key software components.
Design, develop and maintain scalable data models and schemas using various data modelling best practices.
Design and develop integration connectors to facilitate data integration from multiple sources and systems, including databases, APIs, log files, streaming platforms, IoT end devices and external data providers.
Data Transformation and Processing : Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis or reporting.
Strong knowledge of data manipulation languages such as SQL necessary to build and maintain complex queries and data pipelines.
Implement event-driven processing pipelines using frameworks like Solace Pubsub, Apache Kafka, MQTT, AMQP.
Ensure compliance to data governance policies and standards to ensure data quality, integrity, security and consistency.
Experience working in a dynamic environment with managing senior stakeholders from different organisations and agencies.

Requirements

Bachelor's / Master's degree specializing in Computer Science / Engineering / Industrial Engineering or related field. Diploma holders with relevant experience are encouraged to apply.

Proficiency in at least one object-oriented language; Java skills are highly desirable.

Proficient in AWS

Deep understanding in designing, implementing data lifecycle management.

Deep understanding of Event driven architecture, data producers and consumers.

Knowledge on data analytics pipeline, data lakehouse & warehouse concept. Curate data for exporting to data analytics tools for data processing pipeline to provide business analytics outcomes.

Experience with relational and non-relational databasesFamiliar with Product Development and Design thinking approach

Excellent communication, collaboration, and problem-solving skills

Ability to work independently and as part of a team.

5 day week @ AMK area

Maestro HR

damien lee tian hong

R1106726

16C8462

Tell employers what skills you have

AWS D9.1

Amazon AWS

Pipelines

AWS

Data Structures

Data Transformation

Industrial Engineering

ETL

Data Integration

Data Quality

AMQP

Data Governance

SQL

Business Analytics

Apache Kafka

Design Thinking

Java

AWS Lambda

Data Analytics

Databases

Create a job alert for this search

Data Engineer • Islandwide, SG