FDA Broadens Focus to Examine AI Use in Drug Operations: Law Firm
A recent FDA Warning Letter is signaling a broader regulatory focus on how drugmakers use artificial intelligence (AI), according to a new analysis by law firm Morgan Lewis. In a 4/24 blog post, the firm said the agency is moving beyond its earlier oversight of AI as a regulated product — such as software classified as a medical device — and is now scrutinizing how companies deploy AI tools within core pharmaceutical operations, including manufacturing and quality systems.
The shift comes after FDA cited a drug manufacturer (see earlier story) for relying on an AI system to generate key compliance documents, including production records and procedures required under current good manufacturing practice regulations. According to the analysis, regulators found that the company failed to adequately review or validate AI-generated materials and, in some cases, blamed the technology for missing critical regulatory requirements.
That stance drew a clear line from the agency: companies remain fully accountable for compliance, regardless of whether AI tools are involved. “This warning letter sends an unambiguous message that reliance on AI is not a defense against regulatory violations,” the Morgan Lewis analysis noted, adding that FDA expects human oversight to remain central to all regulated activities.
The development marks what the firm described as an expansion of FDA oversight beyond CDRH’s domain, suggesting increased attention from other parts of the agency involved in drug regulation. The warning also highlights emerging risks as pharmaceutical and biotechnology companies accelerate adoption of AI across their operations. While AI can streamline documentation and support compliance workflows, FDA’s action indicates that insufficient validation or overreliance on automated outputs could trigger enforcement.
Morgan Lewis outlined several implications for industry. Among them: companies must ensure that AI-generated content is rigorously reviewed by qualified personnel; responsibility for compliance cannot be delegated to technology; and organizations should establish formal governance frameworks to guide AI use, including policies, training, and defined accountability structures.
The analysis concludes that FDA’s latest enforcement action serves as a warning shot for the life sciences sector, underscoring that while AI may play an increasing role in drug development and manufacturing, it cannot replace human judgment in meeting regulatory standards.