How Well Can Modern LLMs Act as Agent Cores in Radiology Environments?
Technical Report, 2024
We evaluate modern LLMs as agent cores in radiology environments through a comprehensive dataset, innovative evaluation platform, and performance assessments of leading models. Results highlight key challenges in tool comprehension, information synthesis, and format maintenance, confirming that while promising, current LLMs are not yet ready to serve as standalone radiology agent cores.