Ruizhong Qiu

rq5 AT illinois DOT edu
[Google Scholar] | [LinkedIn] | [GitHub]
Avatar

I am a Ph.D. student in computer science (CS) at the University of Illinois Urbana–Champaign (UIUC), fortunately advised by Professor Hanghang Tong. Prior to this, I earned an M.S. degree in CS at UIUC and a B.E. degree in operations research and a minor in statistics at Tsinghua University.

My current research focuses on large language models (LLMs) & agents (especially their post-training), and I have also worked on graph machine learning and time series analysis. My research interests lie broadly in theoretical foundations and methodological advances of machine learning (ML).

Education

  • University of Illinois Urbana–Champaign | Siebel School of Computing and Data Science
    M.S. & Ph.D. in Computer Science, Fall 2022 – Spring 2027 (Expected)
    Advisor: Professor Hanghang Tong
  • Tsinghua University | Department of Industrial Engineering
    B.E. in Operations Research & Minor in Statistics, Fall 2018 – Spring 2022

Experience

  • Meta AI | Part-Time Student Researcher | Remote
    Reinforcement routing for mixtures of LoRAs in LLM finetuning, August 25 – December 12, 2025
    Mentors: Hanqing Zeng, Yinglong Xia
  • Meta AI | Research Scientist Intern | Menlo Park, CA
    Soft graph clustering for LLM-based generative recommendation, May 19 – August 15, 2025
    Mentors: Yinglong Xia, Hanqing Zeng
  • Qualcomm AI Research | Research Engineering Intern | San Diego, CA
    Automatic mixed-precision quantization of diffusion models, June 4 – August 9, 2024
    Mentors: Burak Bartan, Weiliang Will Zeng
  • Qualcomm AI Research | Research Engineering Intern | San Diego, CA
    Code generation with large language models, May 22 – August 4, 2023
    Mentor: Weiliang Will Zeng

Research

Large Language Models & Agents
  • ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuning
    Ruizhong Qiu, Hanqing Zeng, Yinglong Xia, Yiwen Meng, Ren Chen, Jiarui Feng, Dongqi Fu, Qifan Wang, Jiayi Liu, Jun Xiao, Xiangjun Fan, Benyu Zhang, Hong Li, Zhining Liu, Hyunsik Yoo, Zhichen Zeng, Tianxin Wei, Hanghang Tong
    Under review, 2026
  • [VLMRWD@NeurIPS 2025] Efficient inference scaling for safety assurance
    Ruizhong Qiu*, Gaotang Li*, Ting-Wei Li*, Tianxin Wei, Jingrui He, Hanghang Tong
    NeurIPS 2025 Workshop on Vision--Language Model Real-World Deployment, 2025
    [Paper] | [Code] | [Webpage] | [arXiv]
  • [ICLR 2025] Ask, and it shall be given: On the Turing completeness of prompting
    Ruizhong Qiu, Zhe Xu, Wenxuan Bao, Hanghang Tong
    The Thirteenth International Conference on Learning Representations, 2025
    [Paper] | [GitHub] | [Poster] | [arXiv]>
  • [ICLR 2025] How efficient is LLM-generated code? A rigorous & high-standard benchmark
    Ruizhong Qiu, Weiliang Will Zeng, James Ezick, Christopher Lott, Hanghang Tong
    The Thirteenth International Conference on Learning Representations, 2025
    [GitHub] | [HuggingFace] | [PyPI] | [Paper] | [Poster] | [arXiv]
  • Beyond log likelihood: Probability-based objectives for supervised fine-tuning across the model capability continuum
    Gaotang Li*, Ruizhong Qiu*, Xiusi Chen*, Heng Ji, Hanghang Tong
    arXiv preprint, 2025
    [Code] | [arXiv]
  • WAPITI: A watermark for finetuned open-source LLMs
    Lingjie Chen*, Ruizhong Qiu*, Siyu Yuan, Zhining Liu, Tianxin Wei, Hyunsik Yoo, Zhichen Zeng, Deqing Yang
    arXiv preprint, 2024
    [Code] | [arXiv]
  • Latent collaboration in multi-agent systems
    Jiaru Zou*, Xiyuan Yang*, Ruizhong Qiu*, Gaotang Li*, Katherine Tieu*, Pan Lu*, Ke Shen, Hanghang Tong, Yejin Choi, Jingrui He, James Zou, Mengdi Wang, Ling Yang
    arXiv preprint, 2025
    [Code] | [arXiv]
  • [ICCV 2025] Latte: Collaborative test-time adaptation of vision-language models in federated learning
    Wenxuan Bao, Ruxi Deng, Ruizhong Qiu, Tianxin Wei, Hanghang Tong, Jingrui He
    Proceedings of the IEEE/CVF International Conference on Computer Vision, 2025
    [Code] | [Paper] | [arXiv]
  • [EACL 2026] Harnessing consistency for robust test-time LLM ensemble
    Zhichen Zeng, Qi Yu, Xiao Lin, Ruizhong Qiu, Xuying Ning, Tianxin Wei, Yuchen Yan, Jingrui He, Hanghang Tong
    Findings of EACL 2026, 2026
    [Code] | [arXiv]
  • [NeurIPS 2025 Spotlight] Transformer copilot: Learning from the mistake log in LLM fine-tuning
    Jiaru Zou, Yikun Ban, Zihao Li, Yunzhe Qi, Ruizhong Qiu, Ling Yang, Jingrui He
    Advances in Neural Information Processing Systems 38, 2025
    [Code] | [Paper] | [arXiv]
  • [ICLR 2026] Influence-preserving proxies for gradient-based data selection in LLM finetuning
    Sirui Chen, Yunzhe Qi, Mengting Ai, Yifan Sun, Ruizhong Qiu, Jiaru Zou, Jingrui He
    The Fourteenth International Conference on Learning Representations, 2026
  • Geometric disentangelment unlearning
    Duo Zhou*, Yuji Zhang*, Tianxin Wei, Ruizhong Qiu, Ke Yang, Xiao Lin, Cheng Qian, Jingrui He, Hanghang Tong, Heng Ji, Huan Zhang
    arXiv preprint, 2025
    [arXiv]
  • Agentic reasoning for large language models: A survey
    Tianxin Wei, Ting-Wei Li, Zhining Liu, Xuying Ning, Ze Yang, Jiaru Zou, Zhichen Zeng, Ruizhong Qiu, Xiao Lin, Dongqi Fu, Zihao Li, Mengting Ai, Duo Zhou, Wenxuan Bao, Yunzhe Li, Gaotang Li, Cheng Qian, Yu Wang, Xiangru Tang, Yin Xiao, Liri Fang, Hui Liu, Xianfeng Tang, Yuji Zhang, Chi Wang, Jiaxuan You, Heng Ji, Hanghang Tong, Jingrui He
    HuggingFace #1 of the Week, 2026
    [arXiv] | [HuggingFace] | [GitHub]
Graph Machine Learning
Time Series Analysis

* Equal contribution.

Awards

Publications

Conference Papers
Journal Papers
  • [TMLR 2026] Pave your own path: Graph gradual domain adaptation on fused Gromov–Wasserstein geodesics
    Zhichen Zeng, Ruizhong Qiu, Wenxuan Bao, Tianxin Wei, Xiao Lin, Yuchen Yan, Tarek F. Abdelzaher, Jiawei Han, Hanghang Tong
    Transactions on Machine Learning Research, 2026
    [arXiv]
  • [TMLR 2026] DiffKGW: Stealthy and robust diffusion model watermarking
    Tianxin Wei, Ruizhong Qiu, Yifan Chen, Yunzhe Qi, Jiacheng Lin, Wenxuan Bao, Wenju Xu, Sreyashi Nag, Ruirui Li, Hanqing Lu, Zhengyang Wang, Chen Luo, Hui Liu, Suhang Wang, Jingrui He, Qi He, Xianfeng Tang
    Transactions on Machine Learning Research, 2026
Workshop Papers
Preprints
  • PolymerArena: Benchmarking multi-task graph learning models on polymer property prediction
    Yinqi Zeng, Ruizhong Qiu, Yuanchen Bei, Hanghang Tong, Renjie Li
    ChemRxiv preprint, 2026
    [ChemRxiv]
  • ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuning
    Ruizhong Qiu, Hanqing Zeng, Yinglong Xia, Yiwen Meng, Ren Chen, Jiarui Feng, Dongqi Fu, Qifan Wang, Jiayi Liu, Jun Xiao, Xiangjun Fan, Benyu Zhang, Hong Li, Zhining Liu, Hyunsik Yoo, Zhichen Zeng, Tianxin Wei, Hanghang Tong
    Under review, 2026
  • Agentic reasoning for large language models: A survey
    Tianxin Wei, Ting-Wei Li, Zhining Liu, Xuying Ning, Ze Yang, Jiaru Zou, Zhichen Zeng, Ruizhong Qiu, Xiao Lin, Dongqi Fu, Zihao Li, Mengting Ai, Duo Zhou, Wenxuan Bao, Yunzhe Li, Gaotang Li, Cheng Qian, Yu Wang, Xiangru Tang, Yin Xiao, Liri Fang, Hui Liu, Xianfeng Tang, Yuji Zhang, Chi Wang, Jiaxuan You, Heng Ji, Hanghang Tong, Jingrui He
    HuggingFace #1 of the Week, 2026
    [arXiv] | [HuggingFace] | [GitHub]
  • Subspace alignment for vision-language model test-time adaptation
    Zhichen Zeng, Wenxuan Bao, Xiao Lin, Ruizhong Qiu, Tianxin Wei, Xuying Ning, Yuchen Yan, Chen Luo, Monica Xiao Cheng, Jingrui He, Hanghang Tong
    arXiv preprint, 2026
    [arXiv]
  • AdaFuse: Adaptive ensemble decoding with test-time scaling for LLMs
    Chengming Cui*, Tianxin Wei*, Ziyi Chen, Ruizhong Qiu, Zhichen Zeng, Zhining Liu, Xuying Ning, Duo Zhou, Jingrui He
    arXiv preprint, 2026
    [arXiv]
  • CoFiRec: Coarse-to-fine tokenization for generative recommendation
    Tianxin Wei*, Xuying Ning*, Xuxing Chen*, Ruizhong Qiu, Yupeng Hou, Yan Xie, Shuang Yang, Zhigang Hua, Jingrui He
    arXiv preprint, 2025
    [arXiv]
  • Latent collaboration in multi-agent systems
    Jiaru Zou*, Xiyuan Yang*, Ruizhong Qiu*, Gaotang Li*, Katherine Tieu*, Pan Lu*, Ke Shen, Hanghang Tong, Yejin Choi, Jingrui He, James Zou, Mengdi Wang, Ling Yang
    arXiv preprint, 2025
    [Code] | [arXiv]
  • Geometric disentangelment unlearning
    Duo Zhou*, Yuji Zhang*, Tianxin Wei, Ruizhong Qiu, Ke Yang, Xiao Lin, Cheng Qian, Jingrui He, Hanghang Tong, Heng Ji, Huan Zhang
    arXiv preprint, 2025
    [arXiv]
  • Hierarchical LoRA MoE for efficient CTR model scaling
    Zhichen Zeng, Mengyue Hang, Xiaolong Liu, Xiaoyi Liu, Xiao Lin, Ruizhong Qiu, Tianxin Wei, Zhining Liu, Siyang Yuan, Chaofei Yang, Yiqun Liu, Hang Yin, Jiyan Yang, Hanghang Tong
    arXiv preprint, 2025
    [arXiv]
  • Beyond log likelihood: Probability-based objectives for supervised fine-tuning across the model capability continuum
    Gaotang Li*, Ruizhong Qiu*, Xiusi Chen*, Heng Ji, Hanghang Tong
    arXiv preprint, 2025
    [Code] | [arXiv]
  • MORALISE: A structured benchmark for moral alignment in visual language models
    Xiao Lin*, Zhining Liu*, Ze Yang*, Gaotang Li, Ruizhong Qiu, Shuke Wang, Hui Liu, Haotian Li, Sumit Keswani, Vishwa Pardeshi, Huijun Zhao, Wei Fan, Hanghang Tong
    arXiv preprint, 2025
    [Dataset] | [arXiv]
  • TRQA: Time series reasoning question and answering benchmark
    Baoyu Jing, Sanhorn Chen, Lecheng Zheng, Boyu Liu, Zihao Li, Jiaru Zou, Tianxin Wei, Zhining Liu, Zhichen Zeng, Ruizhong Qiu, Xiao Lin, Yuchen Yan, Qi Yu, Dongqi Fu, Jingrui He, Hanghang Tong
    Under review, 2025
  • WAPITI: A watermark for finetuned open-source LLMs
    Lingjie Chen*, Ruizhong Qiu*, Siyu Yuan, Zhining Liu, Tianxin Wei, Hyunsik Yoo, Zhichen Zeng, Deqing Yang
    arXiv preprint, 2024
    [Code] | [arXiv]
  • Fair anomaly detection for imbalanced groups
    Ziwei Wu, Lecheng Zheng, Yuancheng Yu, Ruizhong Qiu, John Birge, Jingrui He
    arXiv preprint, 2024
    [arXiv]
  • Logic query of thoughts: Guiding large language models to answer complex logic queries with knowledge graphs
    Lihui Liu, Zihao Wang, Ruizhong Qiu, Yikun Ban, Eunice Chan, Yangqiu Song, Jingrui He, Hanghang Tong
    arXiv preprint, 2024
    [arXiv]

* Equal contribution.

Activities

Invited Talks
Academic Service