Publications

* equal contribution  ·  Google Scholar · Semantic Scholar

2026
ICLR 2026
Emergence of Superposition: Unveiling the Training Dynamics of Chain of Continuous Thought
Hanlin Zhu, Shibo Hao, Zhiting Hu, Jiantao Jiao, Stuart Russell, Yuandong Tian
International Conference on Learning Representations (ICLR), 2026
Paper Code
ICLR 2026
LLM Pretraining with Continuous Concepts
Jihoon Tack, Jack Lanchantin, Jane Yu, Andrew Cohen, Ilia Kulikov, Janice Lan, Shibo Hao, Yuandong Tian, Jason Weston, Xian Li
International Conference on Learning Representations (ICLR), 2026
Paper
2025
NeurIPS 2025
Reasoning by Superposition: A Theoretical Perspective on Chain of Continuous Thought
Hanlin Zhu*, Shibo Hao*, Zhiting Hu, Jiantao Jiao, Stuart Russell, Yuandong Tian
Advances in Neural Information Processing Systems (NeurIPS), 2025
Paper Code
NeurIPS 2025
Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective
Zhoujun Cheng*, Shibo Hao*, Tianyang Liu*, Fan Zhou, Yutao Xie, Feng Yao, Yuexin Bian, Yonghao Zhuang, Nilabjo Dey, Yuheng Zha, et al.
Advances in Neural Information Processing Systems (NeurIPS), 2025
Paper Code
COLM 2025 Quanta Magazine
Training Large Language Models to Reason in a Continuous Latent Space
Shibo Hao, Sainbayar Sukhbaatar, DiJia Su, Xian Li, Zhiting Hu, Jason Weston, Yuandong Tian
Conference on Language Models (COLM), 2025
Paper Code
ACL 2025
Offline Reinforcement Learning for LLM Multi-Step Reasoning
Huaijie Wang*, Shibo Hao*, Hanze Dong, Shenao Zhang, Yilin Bao, Ziran Yang, Yi Wu
Findings of the Association for Computational Linguistics (ACL), 2025
Paper Code
ICML 2025
Flow of Reasoning: Efficient Training of LLM Policy with Divergent Thinking
Fangxu Yu, Lai Jiang, Haoqiang Kang, Shibo Hao, Lianhui Qin
International Conference on Machine Learning (ICML), 2025
Paper Code
Technical Report
K2-Think: A Parameter-Efficient Reasoning System
K2-Think Team (incl. Shibo Hao as core contributor)
arXiv preprint, 2025
Paper
Technical Report
K2-V2: A 360-Open, Reasoning-Enhanced LLM
K2-V2 Team (incl. Shibo Hao)
arXiv preprint, 2025
Paper
2024
COLM 2024
LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Models
Shibo Hao*, Yi Gu*, Haotian Luo*, Tianyang Liu, Xiyan Shao, Xinyuan Wang, Shuhua Xie, Haodi Ma, Adithya Samavedhi, Qiyue Gao, Zhen Wang, Zhiting Hu
Conference on Language Models (COLM), 2024
Project Paper Code
Technical Report
Pandora: Towards General World Model with Natural Language Actions and Video States
Jiannan Xiang*, Guangyi Liu*, Yi Gu*, Qiyue Gao, Yuting Ning, Yuheng Zha, Zeyu Feng, Tianhua Tao, Shibo Hao, Yemin Shi, Zhengzhong Liu, Eric P. Xing, Zhiting Hu
arXiv preprint, 2024
Project Paper Code
2023
NeurIPS 2023 Oral Best Paper · SoCalNLP
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings
Shibo Hao, Tianyang Liu, Zhen Wang, Zhiting Hu
Advances in Neural Information Processing Systems (NeurIPS), 2023 · Oral Presentation
Paper Code
EMNLP 2023 State of AI Report 2023
Reasoning with Language Model is Planning with World Model
Shibo Hao*, Yi Gu*, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, Zhiting Hu
Empirical Methods in Natural Language Processing (EMNLP), 2023
Paper Code
ACL 2023
BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Models
Shibo Hao*, Bowen Tan*, Kaiwen Tang*, Bin Ni, Xiyan Shao, Hengzhe Zhang, Eric Xing, Zhiting Hu
Findings of the Association for Computational Linguistics (ACL), 2023
Paper Code
Book Chapter
Neural-Symbolic Interaction and Co-Evolving
Bowen Tan, Shibo Hao, Eric Xing, Zhiting Hu
Compendium of Neurosymbolic Artificial Intelligence, IOS Press, 2023 · pp. 125–152
2022
ACL 2022
Does Recommend-Revise Produce Reliable Annotations? An Analysis on Missing Instances in DocRED
Quzhe Huang, Shibo Hao, Yuan Ye, Shengqi Zhu, Yansong Feng, Dongyan Zhao
Association for Computational Linguistics (ACL), 2022
Paper Code