Microsoft’s AI: Solving 80% of NEJM Cases, Redefining Diagnostic Excellence

Microsoft has announced a significant breakthrough in artificial intelligence, revealing an AI system that “solved” over 80% of complex case studies from the New England Journal of Medicine (NEJM), far exceeding the 20% success rate of human doctors. This achievement redefines diagnostic excellence and marks a “path to medical superintelligence.”
The system, developed by Microsoft’s AI unit under Mustafa Suleyman, imitates a panel of expert physicians to tackle “diagnostically complex and intellectually demanding” cases. Its superior performance, especially when paired with OpenAI’s O3 AI model, underscores its capacity to process and interpret intricate medical data with unparalleled precision.
Beyond its diagnostic capabilities, Microsoft also highlights the AI’s efficiency in ordering tests, which could lead to substantial cost reductions in healthcare systems. Despite the ambitious “superintelligence” claim, Microsoft is keen to stress that AI will serve as a powerful complement to doctors, enabling them to focus on crucial human aspects of patient care.
The research’s unique approach involved transforming over 300 NEJM case studies into “interactive case challenges.” The AI’s “diagnostic orchestrator” then systematically works through these cases, asking pertinent questions and recommending diagnostic tests, much like a real-world clinician, demonstrating a deep, reasoned understanding of medical conditions.