Data Engineer - CT-FNC241121 008 / 01

Our Client is a leading technology services firm recognized for advancing its clients' digital transformation journeys. The company specializes in providing innovative solutions across industries such as healthcare, transport, and financial services, leveraging cutting-edge technologies to deliver impactful results.

Job Overview :

They are seeking a highly skilled and motivated Data Engineer to join their dynamic team. The ideal candidate will be responsible for designing, developing, and optimizing data pipelines, ensuring efficient data management and accessibility across various platforms. As a Data Engineer, you will collaborate closely with stakeholders to ensure data quality, accuracy, and security, while implementing cutting-edge technologies for data processing and analysis.

Key Responsibilities :

• Data Pipeline Development :
• Design, develop, and optimize large-scale ETL pipelines using Apache Spark, SQL, and Python to process both structured and unstructured data efficiently.
• Distributed Query Engines :
• Work with distributed query engines like Presto and Hive to manage and analyze large datasets across distributed systems.
• Time Series Data Management :
• Implement and maintain time series data solutions, particularly leveraging InfluxDB or other time series databases to manage and process time-sensitive data.
• Data Modeling :
• Design and implement scalable data models to support analytical needs and business intelligence, ensuring they are optimized for high performance.
• Optimization :
• Continuously optimize existing data pipelines and processes, implementing automation techniques to efficiently handle growing data volumes.
• Collaboration :
• Work closely with cross-functional teams, including stakeholders from analytics, product, and engineering, to ensure the accessibility, accuracy, and security of data.

Requirements