Yongbin Li, graduated from Tsinghua University, is working in Alibaba Tongyi. My research direction is LLMs, including Pre-training, Post-Training, Reward Model, Reinforcement Learning, Character Model and Code Model. I am responsible for the application of the aforementioned technologies for products such as: Tongyi Lingma, Tongyi Xiaomi,Tongyi Xingchen, Tongyi Tingwu. In recent years, I have published 90+ top conference papers, including ACL/EMNLP/ICML/ NeurIPS/AAAI/SIGIR/KDD, etc. I also have served as the area chair for ACL, NAACL and WSDM.
李永彬，毕业于清华大学，阿里巴巴通义实验室。主要研究方向为大模型相关技术，包括Pre-training、Post-Training、Reward Model、Reinforcement Learning、Character Model、Code Model等。同时负责 通义灵码(编码助手)，通义晓蜜（AI Agent），通义星尘（个性对话/角色对话/数字分身/数字人）， 通义听悟（音视频工作学习助手）等产品的大模型技术，通义灵码已经成为国内用户规模最大的智能编码助手，通义星尘是国内领先的角色对话/分身复刻/数字人产品，通义晓蜜是国内市占率第一的智能客服产品。 2020年以来，发表 90+ 篇国际顶会论文，包括 ACL/EMNLP/ICLR/ ICML/NeurIPS/AAAI/SIGIR/KDD等会议，并先后担任ACL/NAACL/WSDM等国际顶级会议的领域主席。
🔥 News
- 【2025-02】: 17 papers submitted to ACL 2025, directions such as reward models, reinforcement learning, and complex instruction following
- 【2025-01】: 3 papers are accepted by ICLR 2025, including 1 oral paper ！
- 【2024-06】: Area Chairs for ACL ARR
- 【2024-05】: 6 papers are accepted by ACL 2024 ！
- 【2024-02】: 5 papers are accepted by COLING 2024 ！
- 【2023-12】: meta-reviewer for NAACL 2024
- 【2023-10】: 7 papers are accepted by EMNLP 2023 ！
- 【2023-09】: BIRD-SQL is accepted by NeurIPS 2023 Spotlight ！
- 【2023-08】: SigDial 2023 DSTC11 workshop BEST PAPER ！
- 【2023-05】: 10 papers are accepted by ACL 2023 ！
- 【2022-10】: 10 papers are accepted by EMNLP 2022 ！
- 【2022-08】: SPACE 2.0 was accepted by COLING 2022 and was recommended for Best Paper Award ！
- 【2022-08】: SUNSQL was accepted by COLING 2022 and was recommended for Best Paper Award ！
- 【2022-06】: meta-reviewer for WSDM 2023
📝 Selected Publications
* indicates equal contribution
-
SPACE-1 : A Generative Pre-trained Model for Task-Oriented Dialog with Semi-Supervised Learning and Explicit Policy Injection.
Wanwei He*, Yinpei Dai*, Yinhe Zheng, Yuchuan Wu, Zheng Cao, Dermot Liu, Peng Jiang, Min Yang, Fei Huang, Luo Si, Jian Sun, Yongbin Li
[Paper] [Code] [AAAI 2022] -
SPACE-2 : Tree-Structured Semi-Supervised Contrastive Pre-training for Task-Oriented Dialog Understanding.
Wanwei He*, Yinpei Dai*, Binyuan Hui*, Min Yang, Zheng Cao, Jianbo Dong, Jian SUN, Fei Huang, Luo Si and Yongbin Li
[Paper] [Code] [COLING 2022] -
SPACE-3 : Unified Dialog Model Pre-training for Task-Oriented Dialog Understanding and Generation.
Wanwei He*, Yinpei Dai*, Min Yang, Jian Sun, Fei Huang, Luo Si and Yongbin Li
[Paper] [Code] [SIGIR 2022] -
PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts
Yunshui Li, Binyuan Hui, ZhiChao Yin, Min Yang, Fei Huang, Yongbin Li
[Paper] [ACL 2023] -
Speech-Text Pre-training for Spoken Dialog Understanding with Explicit Cross-Modal Alignment.
Tianshu Yu, Haoyu Gao, Ting-En Lin, Min Yang, Yuchuan Wu, Wentao Ma, Chao Wang, Fei Huang, Yongbin Li
[Paper] [ACL 2022] -
Api-bank: A benchmark for tool-augmented llms.
Minghao Li, Feifan Song, Bowen Yu, Haiyang Yu, Zhoujun Li, Fei Huang, Yongbin Li
[Paper] [EMNLP 2023] -
Preference ranking optimization for human alignment.
Feifan Song, Bowen Yu, Minghao Li, Haiyang Yu, Fei Huang, Yongbin Li, Houfeng Wang
[Paper] [AAAI 2024] -
Can llm already serve as a database interface? a big bench for large-scale database grounded text-to-sqls.
Jinyang Li, Binyuan Hui, Ge Qu, Binhua Li, Jiaxi Yang, Bowen Li, Bailin Wang, Bowen Qin, Rongyu Cao, Ruiying Geng, Nan Huo, Chenhao Ma, Kevin CC Chang, Fei Huang, Reynold Cheng, Yongbin Li
[Paper] [NeurIPS 2023] -
SpokenWOZ: A Large-Scale Speech-Text Benchmark for Spoken Task-Oriented Dialogue in Multiple Domains.
Shuzheng Si, Wentao Ma, Yuchuan Wu, Yinpei Dai, Haoyu Gao, Ting-En Lin, Hangyu Li, Rui Yan, Fei Huang, Yongbin Li
[Paper] [NeurIPS 2023] -
Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunch.
Le Yu, Bowen Yu, Haiyang Yu, Fei Huang, Yongbin Li
[Paper] [submitting] -
Wider and deeper llm networks are fairer llm evaluators.
Xinghua Zhang, Bowen Yu, Haiyang Yu, Yangyu Lv, Tingwen Liu, Fei Huang, Hongbo Xu, Yongbin Li
[Paper] [submitting] -
Improving Situated Conversational Agents with Step-by-Step Multi-modal Logic Reasoning.
Yuxing Long, Huibin Zhang, Binyuan Hui, Zhenglu Yang, Caixia Yuan, Xiaojie Wang, Fei Huang, Yongbin Li
[Paper] [SigDial 2023 DSTC11 Workshop Best Paper] -
Iterative Forward Tuning Boosts In-context Learning in Language Models.
Jiaxi Yang, Binyuan Hui, Min Yang, Binhua Li, Fei Huang, Yongbin Li
[Paper] [submitting] -
Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning.
Yunhu Ye, Binyuan Hui, Min Yang, Binhua Li, Fei Huang, Yongbin Li
[Paper] [SIGIR 2023] -
A Survey on Text-to-SQL Parsing: Concepts, Methods, and Future Directions.
Bowen Qin, Binyuan Hui, Lihan Wang, Min Yang, Jinyang Li, Binhua Li, Ruiying Geng, Rongyu Cao, Jian Sun, Luo Si, Fei Huang, Yongbin Li
[Paper] [TKDE 2022] -
UniMSE: Towards Unified Multimodal Sentiment Analysis and Emotion Recognition.
Guimin Hu, Ting-En Lin, Yi Zhao, Guangming Lu, Yuchuan Wu, Yongbin Li
[Paper] [EMNLP 2022] -
Towards Generalizable and Robust Text-to-SQL Parsing.
Chang Gao, Bowen Li, Wenxuan Zhang, Wai Lam, Binhua Li, Fei Huang, Luo Si, Yongbin Li
[Paper] [EMNLP 2022] -
CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation.
Yinpei Dai, Wanwei He, Bowen Li, Yuchuan Wu, Zheng Cao, Zhongqi An, Jian Sun, Yongbin Li
[Paper] [EMNLP 2022] -
Dial2vec: Self-Guided Contrastive Learning of Unsupervised Dialogue Embeddings.
Che Liu, Rui Wang, Junfeng Jiang, Yongbin Li, Fei Huang
[Paper] [EMNLP 2022] -
Prompt Conditioned VAE: Enhancing Generative Replay for Lifelong Learning in Task-Oriented Dialogue.
Yingxiu Zhao, Yinhe Zheng, Zhiliang Tian, Chang Gao, Bowen Yu, Haiyang Yu, Yongbin Li, Jian Sun, Nevin L Zhang
[Paper] [EMNLP 2022] -
Doc2Bot: Accessing Heterogeneous Documents via Conversational Bots.
Haomin Fu, Yeqin Zhang, Haiyang Yu, Jian Sun, Fei Huang, Luo Si, Yongbin Li, Cam-Tu Nguyen
[Paper] [EMNLP 2022] -
STAR: SQL Guided Pre-Training for Context-dependent Text-to-SQL Parsing.
Zefeng Cai, Xiangyu Li, Binyuan Hui, Min Yang, Bowen Li, Binhua Li, Zheng Cao, Weijie Li, Fei Huang, Luo Si, Yongbin Li
[Paper] [EMNLP 2022] -
Graph-to-Text Generation with Dynamic Structure Pruning.
Liang Li, Ruiying Geng, Bowen Li, Can Ma, Yinliang Yue, Binhua Li, Yongbin Li
[Paper] [COLING 2022] -
Proton: Probing Schema Linking Information from Pre-trained Language Models for Text-to-SQL Parsing.
Lihan Wang*, Bowen Qin*, Binyuan Hui*, Bowen Li, Ming Yang, Bailin Wang, Binhua Li, Fei Huang, Luo Si, Yongbin Li
[Paper] [Code] [KDD 2022] -
Duplex Conversation: Enable Human-like Interaction in Spoken Dialogue System.
Ting-En Lin, Yuchuan Wu, Fei Huang, Luo Si, Jian Sun and Yongbin Li
[Paper] [KDD 2022] -
S²SQL: Injecting Syntax to Question-schema Interaction Graph Encoder for Text-to-SQL Parsers.
Binyuan Hui, Ruiying Geng, Lihan Wang, Bowen Qin, Bowen Li, Jian Sun, Yongbin Li
[Paper] [Code] [ACL 2022 Findings] -
A Slot Is Not Built in One Utterance: Spoken Language Dialogs with Sub-Slots.
Sai Zhang, Yuwei Hu, Yuchuan Wu, Jiaman Wu, Yongbin Li, Jian SUN, Caixia Yuan and Xiaojie Wang
[Paper] [ACL 2022 Findings] -
A Survey on Neural Open Information Extraction: Current Status and Future Directions.
Shaowen Zhou, Bowen Yu, Aixin Sun, Cheng Long, Jingyang Li, Haiyang Yu, Jian Sun, Yongbin Li
[Paper] [IJCAI 2022] -
Layout-Aware Information Extraction for Document-Grounded Dialogue: Dataset, Method and Demonstration.
Zhenyu Zhang, Bowen Yu, Haiyang Yu, Tingwen Liu, Cheng Fu, Jingyang Li, Chengguang Tang, Jian Sun, Yongbin Li
[Paper] [ACM MM 2022] -
Preview, Attend and Review: Schema-Aware Curriculum Learning for Multi-Domain Dialogue State Tracking.
Yinpei Dai, Hangyu Li, Yongbin Li, Jian Sun, Fei Huang, Luo Si and Xiaodan Zhu
[Paper] [ACL 2021] -
R²SQL: Dynamic Hybrid Relation Network for Cross-Domain Context-Dependent Semantic Parsing.
Binyuan Hui, Ruiying Geng, Qiyu Ren, Binhua Li, Yongbin Li, Jian Sun, Fei Huang, Luo Si, Pengfei Zhu, Xiaodan Zhu
[Paper] [Code] [AAAI 2021] -
Improving text-to-sql with schema dependency learning.
Binyuan Hui, Xiang Shi, Ruiying Geng, Binhua Li, Yongbin Li, Jian Sun, Xiaodan Zhu
[Paper] [arXiv] -
Learning Low-Resource End-To-End Goal-Oriented Dialog for Fast and Reliable System Deployment.
Yinpei Dai, Hangyu Li, Chengguang Tang, Yongbin Li, Jian Sun, Xiaodan Zhu
[Paper] [ACL 2020] -
Dynamic Memory Induction Networks for Few-Shot Text Classification.
Ruiying Geng, Binhua Li, Yongbin Li, Jian Sun, Xiaodan Zhu
[Paper] [ACL 2020] -
Induction Networks for Few-Shot Text Classification.
Ruiying Geng, Binhua Li, Yongbin Li, Xiaodan Zhu, Ping Jian, Jian Sun
[Paper] [EMNLP 2019]