Senior Data Engineer

Roles & Responsibilities

We are partnering with a leading organisation to hire a Senior Data Engineer This is an exciting opportunity for a hands-on engineer with strong experience in cloud data platforms, data engineering, streaming technologies, and Generative AI.

Key responsibilities include but are not limited to:

• Design, build, optimise, and operate scalable batch and streaming data pipelines using technologies such as Databricks, Apache Kafka, Microsoft Fabric, and Delta Lake.

• Develop robust data ingestion, transformation, and serving capabilities across diverse source systems, including files, APIs, databases, and streaming platforms.

• Use Python, SQL, and PySpark to transform, cleanse, validate, and prepare data for downstream consumption.

• Lead the implementation and operationalisation of knowledge bases and Retrieval-Augmented Generation (RAG) solutions supporting GenAI and agentic AI use cases across business domains.

• Build and maintain knowledge bases across a range of hosting platforms, including storage, lifecycle management, embedding, and vectorisation capabilities.

To qualify for this Senior Data Engineer role, you should have:

• A Bachelor’s degree in Computer Science, Engineering, or a related discipline.

• 5 yrearss of experience in data engineering, data platform engineering, or cloud-scale analytics solution delivery.

• Demonstrated experience owning and operating production data pipelines and platform components.

• Strong hands-on experience designing, building, optimising, and supporting batch and/or streaming pipelines, including orchestration, observability, error handling, performance tuning, and production support.

If this sounds like the right next step for you, please apply with your CV or reach out directly to joanne@tenten-partners.com for a confidential discussion.

Equal Opportunity Statement

TENTEN Partners is an equal opportunity firm and is committed to providing equal employment opportunities to all qualified individuals without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, or any other protected characteristic as outlined by applicable laws.

Tell employers what skills you have

Analytics Support
Design
AI Agents
Lifecycle Management
Computer Engineering
Source Control
Data Pipeline
Downstream Processing
Databricks
Computer Science
Embedding
Production Support
Knowledge Base
Apache Kafka
Orchestration
Error Handling