Microsoft and Amazon have joined OpenAI in releasing AI health tools, expanding the use of large language models (LLMs) for medical advice. Microsoft's Copilot Health and Amazon's Health AI now offer users access to health information, building on OpenAI's January launch of ChatGPT Health. This surge reflects both the rapid advancement of generative AI capabilities and a significant public demand for accessible health guidance, with Microsoft reporting 50 million daily health queries on Copilot.

However, researchers warn these tools require more rigorous independent evaluation before widespread release, especially in high-stakes areas like health. Concerns persist that companies may not fully identify risks, and even well-intentioned evaluations might miss critical blind spots. Experts emphasize the potential benefits of improving access but stress the urgent need for robust safety testing, particularly for tasks like triage where errors could have serious consequences.