Yudong Li

Assistant Researcher · Department of Electronic Engineering, Tsinghua University

I received my B.Eng. from Central South University and my Ph.D. from Shenzhen University. My research focuses on large-model pre-training, currently centered on Knowledge Context: exploring how to incorporate contextual information into pre-training so that models learn not only knowledge itself, but also the conditions under which such knowledge holds.

Previously, I worked extensively on model frameworks, training methods and evaluation data, and am a core contributor of UER-py, TencentPretrain, Linly, CLUE Benchmark, CSL, and other open-source projects. My broader interests include data engineering and synthetic data for large language models.

I am looking for academic and industry collaborators for the Knowledge Context research program — feel free to reach out.

Selected Publications

Full list on Google Scholar.

ACL 2026

KoCo: Conditioning Language Model Pre-training on Knowledge Coordinates

Yudong Li, Jiawei Cai, Linlin Shen

The 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)

AAAI 2026 (Oral)

OncoCoT: A Temporal-causal Chain-of-Thought Dataset for Oncologic Decision-Making

Peiru Yang, Yudong Li, Shiting Wang, Xinyi Liu, Haotian Gan, Xintian Li, Qingyu Gao, Yongfeng Huang

Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2026)

ACM MM 2024 (Oral)

FLIP-80M: 80 Million Visual-Linguistic Pairs for Facial Language-Image Pre-Training

Yudong Li, Xianxu Hou, Zheng Dezhi, Linlin Shen, Zhe Zhao

Proceedings of the 32nd ACM International Conference on Multimedia (ACM MM 2024)

PDF
Code

ICASSP 2024

Dynamic Data Sampler for Cross-Language Transfer Learning in Large Language Models

Yudong Li, Yuhao Feng, Wen Zhou, Zhe Zhao, Linlin Shen, Cheng Hou, Xianxu Hou

2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2024)

ACL 2023

TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities

Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, et al.

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023)

COLING 2022

CSL: A Large-scale Chinese Scientific Literature Dataset

Yudong Li, Yuqing Zhang, Zhe Zhao, Linlin Shen, Weijie Liu, Weiquan Mao, Hui Zhang

Proceedings of the 29th International Conference on Computational Linguistics (COLING 2022)

ACM MM 2022

Talk2Face: A Unified Sequence-based Framework for Diverse Face Generation and Analysis Tasks

Yudong Li, Xianxu Hou, Zhe Zhao, Linlin Shen, Xuefeng Yang, Kimmo Yan

Proceedings of the 30th ACM International Conference on Multimedia (ACM MM 2022)

COLING 2020

CLUE: A Chinese Language Understanding Evaluation Benchmark

Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, et al.

Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020)