Data engineer - Azure

Flintex Consulting Pte LtdSingapore, Singapore, Singapore

12 days ago

Job description

Benefits

13th Month Salary

Data engineer (Azure)

Synapse and Pyspark, Python, Datawarehouse and Power BI , Azure Devops

Skills & Experience

Bachelor’s Degree in Computer Science or Engineering with 3-5 years of experience in Azure Data engineering, Python, Pyspark or Big Data development
Sound Knowledge of Azure Synapse analytics for pipelines, orchestration, set up
1-2 experience in Visualization design and development with Power BI. Knowledge on row-level security, access control
Sound experience in SQL, Datawarehouse, data marts, data ingestion with Pyspark and Python
Expertise in developing and maintaining ETL processing pipelines in cloud-based platforms such as AWS, Azure, etc. (Azure Synapse or data factory preferred)
Team player with good interpersonal, communication, and problem-solving skills.

Job Scope

Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration

Designing and developing reports and dashboards in Power BI, setting up access control with row-level security, DAX query experience

Establishing connections to source data systems, including internal systems e.g. SAP, Historians, Data Lake, etc. as well as external systems such as Web APIs, etc

Managing the collected data in appropriate storage / data-base solutions e.g. file systems, SQL servers, Big Data platforms such as Hadoop, HANA, etc. as required by the specific project requirements

Design, development of data marts and relevant data pipelines using pyspark, data copy activities for batch ingestion

Deployment of pipeline artifacts from one environment to the other using Azure Devops

Performing data integration e.g. using database table joins, or other mechanisms at an appropriate level as required by the analysis requirements of the project.

Good to have

Data catalog with Purview enabling effective metadata management, lineage tracking, and data discovery

Candidates should demonstrate the ability to leverage Purview to ensure data governance, compliance, and efficient data exploration within Azure environments.

Others

Able to work independently on assignment according to agreed schedule without much supervision

Own assignment and take initiative to resolve issues hinder completion of assignment Proactively reach out for help / guidance whenever required.

#J-18808-Ljbffr

Create a job alert for this search

Data Engineer • Singapore, Singapore, Singapore

Related jobs

Promoted

Data Engineer - Azure

TECHCOM SOLUTIONS (SINGAPORE) PTE. LTD.Singapore, Singapore, Singapore

Design and implement data storage solutions.Create and maintain data storage solutions including.Azure SQL Database, Azure Data Lake, and Azure Blob Storage. Design, implement, and maintain.Create d...Show moreLast updated: 14 days ago

Promoted

Data Engineer

Optiver US LLCSingapore, Singapore, Singapore

Optiver is a global market maker founded in Amsterdam, with offices in London, Chicago, Austin, New York, Sydney, Shanghai, Hong Kong, Singapore, Taipei and Mumbai. Established in 1986, today we are...Show moreLast updated: 18 days ago

Promoted

Senior Azure Data Engineer

Programmers.ioTelangana, India

Job Title : Senior Azure Data Engineer.Skills Required : Azure Synapse, Azure Data Factory, Azure Databricks, and ADLS Gen2, PySpark, SQL,Microsoft Fabrics. Experience Range : 5 Years - 12 years.We are...Show moreLast updated: 13 days ago

Promoted

Senior AWS Data Engineer_Exp : 5+ Years

Atyeti IncTelangana, India

Required Skills & Qualifications.Bachelor’s or Master’s degree in Computer Science or equivalent experience.Application Developer or in similar software engineering roles.Python; strong SQL and clo...Show moreLast updated: 5 days ago

Promoted

Data Engineer

EgenTelangana, India

We are looking for a skilled and motivated Lead Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team.The ideal candidate will...Show moreLast updated: 2 days ago

Promoted

Data engineer - Azure

Flintex Consulting Pte LtdSingapore, Singapore, Singapore

Synapse and Pyspark, Python, Datawarehouse and Power BI , Azure Devops.Bachelor’s Degree in Computer Science or Engineering with 3-5 years of experience in Azure Data engineering, Python, Pyspark o...Show moreLast updated: 12 days ago

Promoted

Data engineer (Azure)

FLINTEX CONSULTING PTE. LTD.Singapore, Singapore, Singapore

Synapse and Pyspark, Python, Datawarehouse and Azure Data Explorer, Azure Devops.Design, review and development of Pyspark scripts. Testing, troubleshooting of data pipelines, orchestration.Implemen...Show moreLast updated: 18 days ago

Promoted

Cloud Engineer (AWS, Azure)

BPMLinksTelangana, India

Job Description – Cloud Engineer (AWS, Azure, Snowflake) : .We are looking for a skilled Cloud Engineer to take ownership of the existing multi-cloud infrastructure and data integration setup.Manage ...Show moreLast updated: 4 days ago

Promoted

Data Engineer

GECO Asia Pte LtdSingapore, Singapore, Singapore

We are seeking an experienced Data Engineer to design, develop, and maintain scalable data storage, integration, and processing solutions on the Azure platform. The ideal candidate will have strong ...Show moreLast updated: 16 days ago

Promoted

Data Architect (Azure)

Charterhouse Partnership | AsiaSingapore, Singapore, Singapore

We are working with a leading financial institution in Singapore.As part of their continued growth, they are looking to hire a Senior Azure Data Platform Solution Architect to join their team.Formu...Show moreLast updated: 30+ days ago

Promoted

Data Architect

DEEEPLABS PTE. LTD.Singapore, Singapore, Singapore

We are seeking a highly skilled and experienced.This role will lead the end-to-end architecture of enterprise-grade data systems, integrating Azure and Microsoft Fabric services with Databricks to ...Show moreLast updated: 30+ days ago

Promoted

Data Engineer

NearaSingapore, Singapore, Singapore

Paradex isn’t just another decentralized exchange—it’s a Super App.We’ve combined three powerful financial primitives : Exchange, Asset Management, and Borrow / Lend Markets, all seamlessly composable...Show moreLast updated: 18 days ago

Promoted

Data Engineer - AWS

Digivance SolutionTelangana

Job Title : Data Engineer Data Platforms (AWS) Location : Hyderabad Experience Requirements <...Show moreLast updated: 30+ days ago

Promoted

Lead Azure Data Architect (Permanent, Banking)

GMP TECHNOLOGIES (S) PTE LTDSingapore, Singapore, Singapore

As the Azure Data Platform Technical Lead, you will plan on-premises system migration, covering migration methodology, data requirements, and compliance strategy, while providing insights to suppor...Show moreLast updated: 30+ days ago

Promoted

Senior Data Engineer (AI)

JAC Recruitment Pte LtdSingapore, Singapore, Singapore

My client is a Global Healthcare organisation and they are looking for a seasoned Senior Data Engineer to lead Snowflake-based data solutions supporting AI and analytics initiatives.This role focus...Show moreLast updated: 12 days ago

Promoted

Senior Cloud Engineer - AWS & Data Lake DBA

Bitdeer (NASDAQ : BTDR)Singapore, Singapore, Singapore

Senior Cloud Engineer – AWS & Data Lake DBA.Be among the first 25 applicants.Senior Cloud Engineer – AWS & Data Lake DBA. Get AI-powered advice on this job and more exclusive features.Bitdeer Techno...Show moreLast updated: 18 days ago

Promoted

Data Engineer (Python / Snowflake / SQL)

ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD.Singapore, Singapore, Singapore

ASTEK has been providing IT and Engineering solutions for some of the world’s largest industrial and services groups for more than 35 years with 10,000 passionate experts in 22 countries throughout...Show moreLast updated: 12 days ago

Promoted

Azure Data Architect

Programmers.ioTelangana, India, India

Job Title : Azure Data Architect.Location : Hyderabad, Pune, Jaipur.Experience required : 12+ years.We are seeking a highly experienced. The ideal candidate should bring strong expertise in SQL, ETL / EL...Show moreLast updated: 3 days ago