Data Engineer

Direct message the job poster from Quadrant Technologies

Enterprise Alliance Builder | Workforce Solutions Consultant – IT Augmentation | Singapore | Malaysia | Saudi Arabia | India

Department : Data & AI Practice

About the Role

We are seeking experienced Databricks Data Engineers to join our IT Services team, which supports a leading bank’s Data Science division. You will play a pivotal role in designing, developing, and maintaining scalable data pipelines and transformation workflows on Azure Databricks, enabling advanced analytics and machine learning initiatives.

Key Responsibilities

• Design, develop, and optimize scalable data ingestion pipelines using Azure Data Factory, Databricks, and Apache Spark.
• Build and maintain Databricks notebooks using PySpark for data preparation, transformation, and enrichment to support Data Science use cases.
• Collaborate closely with Data Scientists to understand data requirements and ensure timely delivery of clean, structured datasets.
• Implement data quality checks, validation rules, and monitoring mechanisms.
• Integrate data from various sources, including structured, semi-structured, and unstructured formats.
• Ensure data security, governance, and compliance with banking regulations.
• Optimize Spark jobs for performance and cost-efficiency in Azure.
• Participate in code reviews, design discussions, and agile ceremonies.
• Document data pipelines, workflows, and technical decisions.

Required Skills & Qualifications

Technical Skills

Soft Skills

Preferred Qualifications

Seniority Level

Employment Type

Job Function

Industries

Referrals increase your chances of interviewing at Quadrant Technologies by 2x.

Get notified about new Data Engineer jobs in Singapore, Singapore .

#J-18808-Ljbffr