Shaokun Zhang College of Information Science and Technology Pennsylvania State University E-mail: shaokun.zhang@psu.edu Github   Twitter   Google Scholor

• Offline Training of Language Model Agents with Functions as Learnable Weights
  Shaokun Zhang*, Jieyu Zhang*, Jiale Liu, Linxin Song, Chi Wang, Ranjay Krishna, Qingyun Wu
  Forty-first International Conference on Machine Learning (ICML)
  Vienna, Austria, July, 2024

• Refined Coreset Selection: Towards Minimal Coreset Size under Model Performance Constraints
  Xiaobo Xia, Jiale Liu, Shaokun Zhang, Qingyun Wu, Hongxin Wei, Tongliang Liu
  Forty-first International Conference on Machine Learning (ICML) (Spotlight Presentation, 355/9473=3.74%)
  Vienna, Austria, July, 2024

• StateFlow: Enhancing LLM Task-Solving through State-Driven Workflows
  Yiran Wu, Tianwei Yue, Shaokun Zhang, Chi Wang, Qingyun Wu
  Conference on Language Model (COLM)
  Philadelphia, USA, October, 2024

• IDEAL: Influence-Driven Selective Annotations Empower In-Context Learners in Large Language Models
  Shaokun Zhang*, Xiaobo Xia*, Zhaoqing Wang, Lin-Hao Chen, Jiale Liu, Qingyun Wu, Tongliang Liu
  Eleventh International Conference on Learning Representations (ICLR)
  Vienna, Austria, May, 2024

• AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversation
  Qingyun Wu, Gagan Bansal, Jieyu Zhang, Yiran Wu, Beibin Li, Erkang Zhu, Li Jiang, Xiaoyun Zhang, Shaokun Zhang, Jiale Liu, Ahmed Hassan Awadallah, Ryen W White, Doug Burger, Chi Wang
  ICLR 2024 Workshop on LLMAgents (Best Paper Award); Conference on Language Model (COLM)
  Philadelphia, USA, October, 2024

• An Empirical Study on Challenging Math Problem Solving with GPT-4
  Yiran Wu, Feiran Jia, Shaokun Zhang, Hangyu Li, Erkang Zhu, Yue Wang, Yin Tat Lee, Richard Peng, Qingyun Wu, Chi Wang
  ICLR 2024 Workshop on LLMAgents (ICLR@LLMAgents)
  Vienna, Austria, May, 2024

• HyperTime: Hyperparameter Optimization for Combating Temporal Distribution Shifts
  Shaokun Zhang, Yiran Wu, Zhonghua Zheng, Qingyun Wu, Chi Wang
  ACM Multimedia (ACM MM)
  Melbourne, Australia, 2024

• Targeted Hyperparameter Optimization with Lexicographic Preferences Over Multiple Objectives
  Shaokun Zhang, Feiran Jia, Chi Wang, Qingyun Wu
  Eleventh International Conference on Learning Representations (ICLR) (Oral Presentation, 91/4955=2.39%)
  Kigali, Rwanda, May, 2023

• Efficient Neural Architecture Search via Dynamic Distribution Pruning
  Xiawu Zheng, Chenyi Yang, Shaokun Zhang, Yan Wang, Baochang Zhang, Yongjian Wu, Yunsheng Wu, Ling Shao, Rongrong Ji
  International Journal of Computer Vision 131.5 (2023): 1234-1249 (IJCV)
  

• You Only Compress Once: Towards Effective and Elastic BERT Compression via Exploit-Explore Stochastic Nature Gradient
  Shaokun Zhang, Xiawu Zheng, Chenyi Yang, Yuchao Li, Yan Wang, Fei Chao, Mengdi Wang, Shen Li, Jun Yang, Rongrong Ji
  Neurocomputing
  

(Sorted by appeard date, *equal contribution)

• Autogen: LLM agents
  Role: Creator. (29.3k stars, Open100: Top 100 Open Source achievements)
  
• FLAML: AutoML and hyperparameter tuning
  Role: Maintainer. (3.3k stars, 1 millon downloads)
  

• Microsoft Research (Redmond), Research Intern
2024.06 - 2024.09
Supervised by Dr. Chi Wang, Dr. Ankur Mallick and Dr. Daniel Madrigal.