李煜东（Yudong Li）

助理研究员 · 清华大学电子工程系

liyudong123@hotmail.com

• GitHub
• Google 学术
• Email

我的研究聚焦于大模型预训练数据工程与数据效能，我是 UER-py、TencentPretrain、Linly、CLUE Benchmark、CSL 等项目的作者。

求职中，欢迎通过邮件联系。

News: 我们最近发布了一篇综述文章 《LLM预训练数据工程的最佳实践》。

研究方向与代表工作

开源项目

• CLUE Benchmark 4.2k Stars
• Linly / Chinese-LLaMA 3.1k Stars
• UER-py 3.1k Stars
• TencentPretrain 1.1k Stars
• CSL 670 Stars

代表性学术成果

完整列表见 Google Scholar。

ACL 2023

TencentPretrain: A Scalable and Flexible Toolkit for Pre-training Models of Different Modalities

Zhe Zhao, Yudong Li, Cheng Hou, Jing Zhao, Rong Tian, Weijie Liu, Yiren Chen, Ningyuan Sun, Haoyan Liu, et al.

Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023)

• PDF
• Code (1.1k stars)

COLING 2022

CSL: A Large-scale Chinese Scientific Literature Dataset

Yudong Li, Yuqing Zhang, Zhe Zhao, Linlin Shen, Weijie Liu, Weiquan Mao, Hui Zhang

Proceedings of the 29th International Conference on Computational Linguistics (COLING 2022)

• PDF
• Code (664 stars)

COLING 2020

CLUE: A Chinese Language Understanding Evaluation Benchmark

Liang Xu, Hai Hu, Xuanwei Zhang, Lu Li, Chenjie Cao, Yudong Li, Yechen Xu, et al.

Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020)

• PDF
• Code (4.2k stars)

Oral ACM MM 2024

FLIP-80M: 80 Million Visual-Linguistic Pairs for Facial Language-Image Pre-Training

Yudong Li, Xianxu Hou, Zheng Dezhi, Linlin Shen, Zhe Zhao

Proceedings of the 32nd ACM International Conference on Multimedia (ACM MM 2024)

• PDF
• Code

ICASSP 2024

Dynamic Data Sampler for Cross-Language Transfer Learning in Large Language Models

Yudong Li, Yuhao Feng, Wen Zhou, Zhe Zhao, Linlin Shen, Cheng Hou, Xianxu Hou

2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP 2024)

• PDF
• Code (3.1k stars)

Oral AAAI 2026

OncoCoT: A Temporal-causal Chain-of-Thought Dataset for Oncologic Decision-Making

Peiru Yang, Yudong Li, Shiting Wang, Xinyi Liu, Haotian Gan, Xintian Li, Qingyu Gao, Yongfeng Huang

Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2026)

• PDF

ACM MM 2022

Talk2Face: A Unified Sequence-based Framework for Diverse Face Generation and Analysis Tasks

Yudong Li, Xianxu Hou, Zhe Zhao, Linlin Shen, Xuefeng Yang, Kimmo Yan

Proceedings of the 30th ACM International Conference on Multimedia (ACM MM 2022)

• PDF

ACL 2026

KoCo: Conditioning Language Model Pre-training on Knowledge Coordinates

Yudong Li, Jiawei Cai, Linlin Shen

The 64th Annual Meeting of the Association for Computational Linguistics (ACL 2026)

• PDF

当前研究：预训练数据表示工程