FDA’s Central Role in AI Regulation
FDA commissioner Robert Califf and two agency colleagues say that historic advances in artificial intelligence (AI) applied to biomedicine and healthcare “must be matched by continuous complementary efforts to better understand how AI performs in the settings in which it is deployed.” Writing in a JAMA Special Communication, the authors say the effort “will entail a comprehensive approach reaching far beyond FDA, spanning the consumer and healthcare ecosystems to keep pace with accelerating technical progress. If not, there is a risk that AI could disappoint similar to other general-purpose technologies deployed in healthcare settings or even create significant harm if untended models’ performance deteriorates or focuses on financial return without adequate attention to impact on clinical outcomes.”
The article says strong oversight by FDA and other agencies aims to protect the long-term success of regulated products by maintaining a high grade of public trust in the regulated space.
It looks at FDA’s history of regulating AI-enabled products and discusses these concepts pertinent to FDA regulation of AI:
- AI regulation within the broader U.S. government and global context;
- keeping up with the pace of change in AI;
- flexible approaches across the spectrum of AI models;
- the use of AI in medical product development;
- preparing for the unknowns of large language models and generative AI;
- the central importance of AI life cycle management;
- the responsibilities of regulated industries;
- maintaining robust supply chains;
- finding the balance between big tech, start-ups, and academia; and
- the tension between using AI to optimize financial returns vs. improving health outcomes.