Roles & Responsibilities
We are looking for Principal Consultant Data Engineer in Singapore. Must have Coding experience in Spark, DBT, Trino and Iceberg technology. Architecture level experience will be preferred with hands-on coding.
- Minimum 5 years of experience in Spark, DBT, Trino and Iceberg technology
- Developed on data pipeline to periodically extract, transform, and load Core Motion data from different types of raw data (parquet, csv, etc.) into parquet files using Python, Spark, and Pandas with qualified data for future analysis.
- Processed data frames during data wrangling with SQL statements through Spark based
- The following additional certificates will be an added advantage : Azure Solutions Architect Expert, AWS Certified Data Engineer, Salesforce Platform Developer II, Salesforce Consultant Certificates.
- Knowledge or understanding of project lifecycle.
- Knowledge or working experience in banking sector is preferred.
- Experience with integration on relevant tools and software such as Spark, DBT, Trino and Iceberg, Gitlab.
- Eagerness to learn and adapt to new technologies especially in the Data & AI domain.
- Excellent verbal and written skills.
Tell employers what skills you have
Leadership
Data Wrangling
Pandas
Oracle
Azure
Technology Architecture
Architect
Agile
SQL
Project Management
Python
Written Skills
Banking
Consulting
Business Development