Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster. Founded by the creators and core maintainers of vLLM, we sit at the intersection of models and hardware—a position that took years to build.
We're looking for an inference runtime engineer to push the boundaries of what's possible in LLM and diffusion model serving. Models grow larger. Architectures shift: mixture-of-experts, multimodal, agentic. Every breakthrough demands innovations on the inference engine itself. You'll work at the core of vLLM, optimizing how models execute across diverse hardware and architectures. Your work will directly impact how the world runs AI inference.
Minimum qualifications:
Bachelor's degree or equivalent experience in computer science, engineering, or similar.
Deep understanding of transformer architectures and their variants.
Strong programming skills in Python with experience in PyTorch internals.
Experience with LLM inference systems (vLLM, TensorRT-LLM, SGLang, TGI).
Ability to read and implement model architectures and inference techniques from research papers.
Demonstrate the ability to contribute performant and maintainable code and debug in complex ML codebases.
Preferred qualifications:
Deep understanding of KV-cache memory management, prefix caching, and hybrid model serving.
Familiarity with RL frameworks and algorithms for LLMs.
Experience with multimodal inference (audio/image/video/text).
Contributions to open-source ML or system infrastructure projects.
Bonus points if you have:
Implemented core features in vLLM or other inference engine projects.
Contributed to vLLM integrations (verl, OpenRLHF, Unsloth, LlamaFactory, etc).
Written widely-shared technical blogs or side projects on vLLM or LLM inference.
Location: This role is based in Singapore.
Compensation: Depending on background, skills, and experience, the expected annual salary range for this position is S$200,000 to S$400,000 annually + equity.
Visa sponsorship: We sponsor visas on a case-by-case basis.
Benefits : Inferact offers a generous benefits package, including medical, dental, and vision coverage.
Member of Technical Staff, Inference • Singapore, SG
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.Founded by the creators and core maintainers of vLLM, we sit ... Show more
Founded in 1950, Westfield FC has been an important part of its local football community for more than 75 years.Today, the club competes in the 8th tier of English football and is backed by an ambi... Show more
Develop design requirements of an NPU given system level specifications.Being part of modelling the performance of the NPU module and its data transaction throughput.Microarchitecture design and RT... Show more
Working Hours: Sunday to Thursday | 11:00 AM to 7:00 PM.This is not an internal IT role.This is not a helpdesk position.This is a vendor-grade technical leadership role operating at OEM engineering... Show more
Technical Team Assistant, Taste & Wellbeing Division - Your future position?.Reporting to APAC RI Technical FC&A Director, Taste & Wellbeing.As a Technical Team Assistant, T&W within Givaudan, you ... Show more
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.Founded by the creators and core maintainers of vLLM, we sit ... Show more
To join a prominent engineering and security system company in the region.Attractive salary package – basic, Aws, Var Bonus and Transport allowance.The Lead Technical Manager will be responsible fo... Show more
Chicago House AC is an American soccer club based in Chicago, Illinois, focused on building a sustainable, community-driven soccer organization in one of the greatest sports cities in the United St... Show more
Sunset Hospitality Group is a leading multinational lifestyle hospitality group, with a wide portfolio encompassing Hotels & Resorts, Restaurants, Beach Clubs, Nightclubs, Fitness Centers, and more... Show more
Develop design requirements of an NPU given system level specifications.Being part of modelling the performance of the NPU module and its data transaction throughput.Microarchitecture design and RT... Show more
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.Founded by the creators and core maintainers of vLLM, we sit ... Show more
Provide hands-on technical leadership within Agile scrum teams to design, develop, test, and deliver software that controls advanced DNA sequencing and genotyping instruments.Lead software architec... Show more
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.Founded by the creators and core maintainers of vLLM, we sit ... Show more
We're looking for a performance engineer to squeeze every FLOP out of modern accelerators.You'll write the kernels and low-level optimizations that make vLLM the fastest inference engine in the wor... Show more
Inferact's mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by making inference cheaper and faster.Founded by the creators and core maintainers of vLLM, we sit ... Show more
Chicago House AC is an American soccer club based in Chicago, Illinois, focused on building a sustainable, community-driven soccer organization in one of the greatest sports cities in the United St... Show more
Technical Team Assistant, Taste & Wellbeing Division - Your future position?.Reporting to APAC RI Technical FC&A Director, Taste & Wellbeing.As a Technical Team Assistant, T&W within Givaudan, you ... Show more
Founded in 1950, Westfield FC has been an important part of its local football community for more than 75 years.Today, the club competes in the 8th tier of English football and is backed by an ambi... Show more
){kind=logo}