About

Attention is ALL You Need!

我是北京邮电大学模式识别与智能系统实验室(PRIS-NLP)的硕士研究生,我的导师是徐蔚然教授。我之前在同一所大学的数学系获得了学士学位。我的研究兴趣包括文本生成、对话预训练和面向任务的对话系统。我在包括ACL、ICLR、SIGIR、EMNLP和NAACL在内的顶级会议上发表了多篇论文。

🔥 新闻

  • 2024-01: 🎉🎉 一篇论文被ICLR2024接收!
  • 2023-05: 🎉🎉 两篇论文被ACL2023主会接收!
  • 2022-10: 🎉🎉 一篇论文已被接受发表在 EMNLP 2022 的 SereTOD 2022 工作坊!
  • 2022-09: 🏆🏆 在 SereTOD 2022 赛道2上获得 EMNLP 2022 的第一名!
  • 2022-05: 🎉🎉 一篇论文已被 SIGIR 2022 接收!

📝 论文

  1. FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue

    Weihao Zeng, Keqing He, Yejie Wang, Chen Zeng, Jingang Wang, Yunsen Xian, Weiran Xu

    ACL 2023 Main Conference paper

  2. Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue Generation

    Weihao Zeng, Lulu Zhao, Keqing He, Ruotong Geng, Jingang Wang, Wei Wu, Weiran Xu

    ACL 2023 Main Conference paper

  3. What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

    Wei Liu, Weihao Zeng, Keqing He, Yong Jiang, Junxian He

    ICLR 2024 paper

  4. Semi-Supervised Knowledge-Grounded Pre-training for Task-Oriented Dialog Systems

    Weihao Zeng, Keqing He, Zechen Wang, Dayuan Fu, Guanting Dong, Ruotong Geng, Pei Wang, Jingang Wang, Chaobo Sun, Wei Wu, Weiran Xu

    SereTOD 2022 WorkShop, EMNLP 2022 paper

  5. ADPL: Adversarial Prompt-based Domain Adaptation for Dialogue Summarization with Knowledge Disentanglement

    Lulu Zhao, Fujia Zheng, Weihao Zeng, Keqing He, Ruotong Geng, Huixing Jiang, Wei Wu, Weiran Xu

    SIGIR 2022 paper

  6. Domain-Oriented Prefix-Tuning: Towards Efficient and Generalizable Fine-tuning for Zero-Shot Dialogue Summarization

    Lulu Zhao, Fujia Zheng, Weihao Zeng, Keqing He, Weiran Xu, Huixing Jiang, Wei Wu, Yanan Wu

    NAACL 2022 paper

  7. Give the Truth: Incorporate Semantic Slot into Abstractive Dialogue Summarization

    Lulu Zhao, Weihao Zeng, Weiran Xu, Jun Guo

    EMNLP 2021 paper

  8. TODSum: Task-Oriented Dialogue Summarization with State Tracking

    Lulu Zhao, Fujia Zheng, Keqing He, Weihao Zeng, Yuejie Lei, Huixing Jiang, Wei Wu, Weiran Xu, Jun Guo, Fanyu Meng

    Arxiv 2022 paper

🎖 竞赛和奖项

  • 2022-09: 🏆🏆 在 SereTOD Challenge 2022 Track 2,EMNLP 2022 上获得第1名!
  • 2021-08: 🏆🏆 在 SMP 2021 会话型 AI 挑战赛上获得第4名!
  • 2021-09: 🏆🏆 在 CCIR 2021 智能 NLU 挑战赛上获得第8名!

I am Weihao Zeng, a postgraduate student at the Pattern Recognition and Intelligent System Laboratory(PRIS-NLP), Beijing University of Posts and Telecommunications, advised by Prof. Weiran Xu. I am also a Research Assistant at the Hong Kong University of Science and Technology, supervised by Prof. Junxian He. Previously, I obtained my Bachelor’s degree from the Mathematics Department of the same university. My research interests include large language models(LLMs), instruction tuning, and dialogue systems. I have published several papers at top conferences, including ACL, ICLR, SIGIR, EMNLP, and NAACL.

Feel free to email me for any form of academic cooperation !

I am actively seeking PhD Program opportunities for the Fall of 2025 ^_^

🔥 News

  • 2024-03: 🎉🎉 One paper have been accepted by NAACL 2024!
  • 2024-02: 🎉🎉 One paper have been accepted by LREC-COLING 2024!
  • 2024-01: 🎉🎉 One paper have been accepted by ICLR 2024!
  • 2023-05: 🎉🎉 Two paper have been accepted by ACL 2023!
  • 2022-10: 🎉🎉 One paper has been accepted at the SereTOD 2022 Workshop, EMNLP 2022!
  • 2022-09: 🏆🏆 Achieved the 1st rank on SereTOD 2022 track 2, EMNLP 2022!

📝 Publications

  1. FutureTOD: Teaching Future Knowledge to Pre-trained Language Model for Task-Oriented Dialogue

    Weihao Zeng, Keqing He, Yejie Wang, Chen Zeng, Jingang Wang, Yunsen Xian, Weiran Xu

    ACL 2023 Main Conference paper

  2. Seen to Unseen: Exploring Compositional Generalization of Multi-Attribute Controllable Dialogue Generation

    Weihao Zeng, Lulu Zhao, Keqing He, Ruotong Geng, Jingang Wang, Wei Wu, Weiran Xu

    ACL 2023 Main Conference paper

  3. What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning

    Wei Liu, Weihao Zeng, Keqing He, Yong Jiang, Junxian He

    ICLR 2024 paper

  4. DivTOD: Unleashing the Power of LLMs for Diversifying Task-Oriented Dialogue Representations

    Weihao Zeng, Dayuan Fu, Keqing He, Yejie Wang, Yukai Xu, Weiran Xu

    NAACL 2024 paper

  5. BootTOD: Bootstrap Task-oriented Dialogue Representations by Aligning Diverse Responses

    Weihao Zeng, Keqing He, Yejie Wang, Dayuan Fu, Weiran Xu

    LREC-COLING 2024 paper

  6. Semi-Supervised Knowledge-Grounded Pre-training for Task-Oriented Dialog Systems

    Weihao Zeng, Keqing He, Zechen Wang, Dayuan Fu, Guanting Dong, Ruotong Geng, Pei Wang, Jingang Wang, Chaobo Sun, Wei Wu, Weiran Xu

    SereTOD 2022 WorkShop, EMNLP 2022 paper

  7. ADPL: Adversarial Prompt-based Domain Adaptation for Dialogue Summarization with Knowledge Disentanglement

    Lulu Zhao, Fujia Zheng, Weihao Zeng, Keqing He, Ruotong Geng, Huixing Jiang, Wei Wu, Weiran Xu

    SIGIR 2022 paper

  8. Domain-Oriented Prefix-Tuning: Towards Efficient and Generalizable Fine-tuning for Zero-Shot Dialogue Summarization

    Lulu Zhao, Fujia Zheng, Weihao Zeng, Keqing He, Weiran Xu, Huixing Jiang, Wei Wu, Yanan Wu

    NAACL 2022 paper

  9. Give the Truth: Incorporate Semantic Slot into Abstractive Dialogue Summarization

    Lulu Zhao, Weihao Zeng, Weiran Xu, Jun Guo

    EMNLP 2021 paper

  10. TODSum: Task-Oriented Dialogue Summarization with State Tracking

Lulu Zhao, Fujia Zheng, Keqing He, Weihao Zeng, Yuejie Lei, Huixing Jiang, Wei Wu, Weiran Xu, Jun Guo, Fanyu Meng

Arxiv 2022 paper

🎖 Competitions and Awards

  • National Scholarship in China (2019/2023)
  • 2022-09: 🏆🏆 Achieved the 1st Award on SereTOD Challenge 2022 track 2, EMNLP 2022!
  • 2021-08: 🏆🏆 Achieved the 4th Award on SMP 2021 Conversational AI Challenge!
  • 2021-09: 🏆🏆 Achieved the 8th Place on CCIR 2021 Intelligent NLU Challenge!