Ontario's auditor general found AI scribe systems used by doctors routinely produce dangerously inaccurate notes. An evaluation of 20 approved vendors showed 60% mixed up prescribed drugs, while nine fabricated treatment suggestions. The Office of the Auditor General of Ontario report details how these tools miss critical details and hallucinate content, risking patient safety despite being rolled out to over 5,000 physicians.

Evaluators using simulated recordings discovered frequent, severe errors. Twelve systems inserted incorrect drug information, and seventeen missed key mental health details discussed in consultations. Six systems entirely failed to capture mental health issues. Such inaccuracies are unacceptable for clinical documentation, where precision is paramount. The report notes no patient harms have been reported, but the potential for devastating consequences is clear.

The audit blames a deeply flawed evaluation process. Scoring gave 30% weight to having a domestic Ontario presence but only 4% for accuracy. Bias controls and security assessments counted for a mere 2% each. This prioritization means vendors with subpar clinical tools can win contracts. The Ontario Ministry of Health must overhaul its procurement criteria to emphasize medical accuracy and data security over local offices.