Lead Machine Learning Engineer

Job responsibilities

• Lead the design and implementation of advanced model optimization pipelines, including quantization, pruning, and distillation.Architect and tune inference runtimes and serving frameworks to achieve optimal performance across deployments.
• Guide teams in implementing high-throughput serving strategies (continuous batching, KV caching, speculative decoding, asynchronous scheduling).
• Develop benchmarks and performance dashboards to measure and communicate system-level efficiency improvements (throughput, latency, GPU utilization, cost).
• Evaluate trade-offs across accuracy, performance, and cost, and design architectures to meet target SLAs across varied hardware environments (cloud, on-prem, edge).
• Collaborate with infrastructure, MLOps, and product teams to embed inference optimization into production workflows and platform designs.
• Provide technical leadership and mentorship to engineers, fostering a culture of experimentation, rigor, and continuous performance improvement.
• Contribute to the development of internal frameworks, reference architectures, and playbooks for scalable and cost-efficient inference.
• Engage with clients to translate optimization outcomes into business value and articulate the ROI of technical improvements.

Job qualifications

Technical Skills

Professional Skills

Other things to know

Learning & Development

There is no one-size-fits-all career path at Thoughtworks : however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.

Job Details

Country : Singapore

City : Singapore

Date Posted : 10-30-2025

Industry : Information Technology

Employment Type : Regular