Large Model Algorithm Researcher(Multimodal & CodeAI)

About

TikTok

TikTok is the leading

destination for short-form mobile video. At TikTok, our mission is

to inspire creativity and bring joy. TikTok's global headquarters

are in Los Angeles and Singapore, and we also have offices in New

York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul,

and Tokyo.

Why Join

Us

Inspiring creativity is at the

core of TikTok's mission. Our innovative product is built to help

people authentically express themselves, discover and connect - and

our global, diverse teams make that possible. Together, we create

value for our communities, inspire creativity and bring joy - a

mission we work towards every day.

We strive to

do great things with great people. We lead with curiosity,

humility, and a desire to make impact in a rapidly growing tech

company. Every challenge is an opportunity to learn and innovate as

one team. We're resilient and embrace challenges as they come. By

constantly iterating and fostering an "Always Day 1" mindset, we

achieve meaningful breakthroughs for ourselves, our company, and

our users. When we create and grow together, the possibilities are

limitless. Join us.

Diversity &

Inclusion

TikTok is committed to creating an

inclusive space where employees are valued for their skills,

experiences, and unique perspectives. Our platform connects people

from across the globe and so does our workplace. At TikTok, our

mission is to inspire creativity and bring joy. To achieve that

goal, we are committed to celebrating our diverse voices and to

creating an environment that reflects the many communities we

reach. We are passionate about this and hope you are

too.

Job

highlights

Positive team

atmosphere, Career growth opportunity, Meals

provided

Responsibilities

Team

introduction :

The TikTok AI Innovation Center

is a department focused on building AI infrastructure and driving

cutting-edge research in AI. We explore industry-leading AI

technologies, including large language models (LLMs) and multimodal

large models, with the goal of developing models that can

understand multilingual content and vast amounts of video data,

ultimately delivering a better content consumption experience for

users. In the Code AI domain, we leverage the powerful code

understanding and reasoning capabilities of LLMs to enhance program

performance and R&D efficiency.

Project

Introduction : Multimodal

foundation large models (VLM) represent a research hotspot in the

industry and a critical technology for TikTok's business scenario

applications. In 2024, TikTok's Innovation Center developed VFM V1,

a multimodal large model tailored for TikTok's business scenarios.

It matches the performance of the best open-source model Qwen VL on

public test sets, while significantly outperforming all other

foundation models on TikTok's business test sets. In the future, we

aim to continuously develop foundation models with efficient

perception and reasoning capabilities, capable of handling

multilingual and massive video content understanding algorithms to

deliver a better content consumption experience for

users.

Project Challenges :

Enhance the multimodal

perception encoder : The current encoder uses a fixed frame rate. We

need to explore more efficient adaptive frame rates while

considering the integration of modalities such as audio and user

behavior.

How to fuse multimodal perception and

thinking capabilities to promote stronger comprehensive perception

and cognitive abilities of the

model.

Qualifications

Minimum

Qualifications :

1. Got doctor degree, with

priority given to those who have published papers in fields such as

machine learning (ML), computer vision (CV), and natural language

processing (NLP).

2. Possess excellent

programming skills, data structure, and algorithm skills,

proficient in C / C++ or Python programming languages. Priority will

be given to those who have won awards in competitions such as

ACM / ICPC, NOI / IOI, Top Coder, and Kaggle.

3.

Have research experience in the field of machine learning,

particularly in large-scale language models (LLMs) and generative

artificial intelligence.

Preferred Qualification :

1. Be passionate about

technology, have outstanding problem analysis and solving

abilities, be enthusiastic about solving challenging problems, and

possess good communication skills and team spirit.