Evolving Interactive Diagnostic Agents in a Virtual Clinical Environment
Pengcheng Qiu*,
Chaoyi Wu*,
Junwei Liu*,
Qiaoyu Zheng,
Yusheng Liao,
Haowen Wang,
Yun Yue,
Qianrui Fan,
Shuai Zhen,
Jian Wang,
Jinjie Gu,
Yanfeng Wang,
Ya Zhang†,
Weidi Xie†
arXiv preprint, 2025
We train LLMs as interactive diagnostic agents with end-to-end multi-turn reinforcement learning. DiagGym, a diagnostics world model built from electronic health records, serves as a virtual clinical environment for closed-loop training, and DiagBench supplies 2.2K physician-validated cases with 3.3K rubrics. The resulting DiagAgent outperforms 11 state-of-the-art LLMs and 2 prompt-engineered agents in both in-domain and out-of-domain settings.