Issues

• Data quality: 18 test_hard items with wrong keys, duplicate options, or a missing figure (verified against this repo's records)

  gersteinlab/MedicalAgentsBench#8 · Filter by author ZhaohanM opened on Sep 23, 2026

• Some data are duplicated

  gersteinlab/MedicalAgentsBench#7 · Filter by author MaoshengLi-fox opened on Sep 24, 2025

• Aflow Setting

  gersteinlab/MedicalAgentsBench#6 · Filter by author minibin071 opened on Aug 5, 2025

• Dataset comprehensiveness

  gersteinlab/MedicalAgentsBench#5 · Filter by author Data-Designer opened on Jun 19, 2025
  1

• Questions on Reproducibility and Error-Bar Reporting in medagents-benchmark

  gersteinlab/MedicalAgentsBench#4 · Filter by author xk-huang opened on Apr 23, 2025
  1

• MDAgent Reimplementation and Potential Bugs

  gersteinlab/MedicalAgentsBench#3 · Filter by author xk-huang opened on Apr 20, 2025
  1

• Release MedAgents-Benchmark Hard Subset on Hugging Face

  gersteinlab/MedicalAgentsBench#2 · Filter by author NielsRogge opened on Mar 11, 2025
  2

• Performance comparison

  gersteinlab/MedicalAgentsBench#1 · Filter by author super-dainiu opened on Feb 13, 2025