Roles & Responsibilities
Senior Data Engineer
In view of business expansion, our client is seeking a Senior Data Engineer based in Singapore. It's an opportunity to spearhead cutting-edge work as part of a highly collaborative and agile team. You will design enterprise data platform, create and manage a single master record for the business entity, ensuring data consistency, accuracy, and reliability.
The Responsibilities :
- Design, develop, and test the deployment and operation phases of the Enterprise Data Platform for both current and future projects.
- Review, build, or restructure data architecture and ensure its ongoing maintenance and testing.
- Implement data governance processes, including data quality management, data profiling, data remediation, and automated data lineage.
- Create and maintain multiple robust and high-performance data processing pipelines within Cloud, Private Data Centre, and Hybrid data ecosystems.
- Assemble large, complex data sets from a wide variety of data sources.
- Develop, deploy, and maintain multiple microservices, REST APIs, and reporting services.
- Design and implement internal processes to automate manual workflows, optimize data delivery, and re-design infrastructure for greater scalability.
- Establish expertise in designing, analyzing, and troubleshooting large-scale distributed systems.
Requirement :
Minimum 8 years of experience in a Data Engineer role.Experience building and operating large-scale data lakes and data warehouses.Experience with Hadoop ecosystem and big data tools.Experience in data governance, including data quality management, data profiling, data remediation, and automated data lineage.Experience with stream-processing systems including Spark-Streaming.Experience working with Cloud services using one or more Cloud providers.Experience with Delta Lake and Databricks.Advanced working experience with relational SQL and NoSQL databases, including Hive, HBase, and Postgres.Deep understanding of SQL and the ability to optimize data queries.Experience with object-oriented / object function scripting languages : Python, Java, Scala, etc.2 Positions AvailableOffice Location : Central, Singapore
Kindly indicate your current / last salary details and also your notice period
Interested candidates kindly forward your CV to dorothyma@peoplesearch.jobs (Dorothy Ma Li, Reg No : R1769176). Feel free to forward this great opportunity to someone who would be a great fit for this role.
All information will be kept strictly confidential. We regret to inform that only successful applicants will be contacted.
PeopleSearch Pte Ltd
EA License No : 16S8057
Tell employers what skills you have
Scalability
Scala
Big Data
Quality Management
Pipelines
Hadoop
Agile
Scripting
Data Quality
Data Governance
Reliability
SQL
Python
Data Architecture
Java
Databases