Artificial Intelligence

In a recent post on this blog, we examined how artificial intelligence (AI) and machine learning (ML) are reshaping the informed consent process in clinical trials—and why the regulatory and legal frameworks surrounding AI in that context are still catching up. That article focused on one corner of the clinical trial lifecycle. This one broadens the lens. Medical devices, and in particular software as a medical device (SaMD) is a different but related category.

In a recent episode of HBO Max’s The Pitt, an emergency-room attending physician shows medical students the time savings that can come from using a generative artificial intelligence (AI) tool to listen to a doctor–patient conversation and populate a medical record in seconds. But the same storyline highlights the downside: the tool invents details, confuses medications, and even swaps “neurology” for “urology”—mistakes that could put a patient at risk.

AI appeared to burst onto the scene in early 2023 and seems to be everywhere, all at once. In reality, AI technology has been integrated into our daily lives for a number of years, most visibly as experienced through the virtual assistants, Siri and Alexa, and its use in medical diagnostic software systems.