AI Scribe Errors in Clinical Notes: The 90-Second Sign-Off Check Before You Lock the Chart

In 2025, general practitioners interviewed by Australian Doctor described commercial ambient scribes inserting complete clinical findings that never happened in the room, including one physician whose software fabricated "a whole neurological exam when I didn't perform one" (Australian Doctor). On Reddit's r/medicine forum in February 2026, clinicians traded similar accounts of invented pedal-pulse checks, flipped chest-pain negations, and phantom referrals (Reddit r/medicine archive). By May 2026, Mass General Brigham had over 3,000 routine ambient-scribe users (WBUR, May 5, 2026), and Beth Israel Lahey Health expanded Heidi across all employed physicians (Business Wire, Apr 28, 2026). At 5:45 PM, facing fourteen unsigned visits, a polished draft tempts every tired clinician to skim and click Sign.

Independent chart audits explain why casual skimming misses clinical landmines. A 2026 audit across three commercial ambient scribes (n = 565 records) found at least one verified failure in 31.3% of the records (NeurIPS 2026). At UC Davis Health, physicians reviewing n = 356 ambient records logged hallucinations in 11.5% of the sample and serious potential-harm errors in 5.3% of the records (JMIR Medical Informatics, 2026). ECRI ranked AI-enabled health technologies and healthcare chatbot misuse #1 on its Top 10 Health Technology Hazards lists for both 2025 and 2026 (ECRI, 2025).

This operational guide serves physicians, nurse practitioners, physician assistants, nurses, and medical assistants who room patients and prep charts. ed.cafe at No Worker Left Behind is an adult AI-literacy nonprofit, not a medical society or law firm; nothing here constitutes clinical practice advice or legal counsel. Follow your institution's medical-staff bylaws, compliance policies, and scope-of-practice rules. See our wider map in the two meanings of AI safety at work.

Why ambient clinical scribes invent physical exams you never performed

Ambient clinical scribes fabricate physical exams because they chain an acoustic speech model to a language model trained on millions of templated medical records, turning exam-room silence and casual history remarks into formal objective exam blocks.

Every commercial scribe runs a two-stage pipeline rather than a literal tape recorder: stage one is automatic speech recognition (ASR), and stage two is a large language model (LLM) formatting SOAP (Subjective, Objective, Assessment, Plan) prose.

In stage one, speech models do not stay silent during exam-room pauses. In the 2024 Careless Whisper study, researchers found invented sentences in 1% of audited Whisper transcriptions during silence or noise, and 38% of those fabricated segments in the study added harmful or false phrasing (Koenecke et al., arXiv:2402.08021). In stage two, the language model predicts clinical lines that statistically follow a complaint in Electronic Health Record (EHR) corpora. When a patient mentions dizziness and says "Everything feels steady when I walk," statistical completion promotes casual history into "Cranial nerves II-XII intact, no focal neurological deficits."

Picture a tired court stenographer who nods off during quiet moments and fills missing lines by copying standard paragraphs from Tuesday's trial. That analogy captures how boilerplate enters the chart, yet breaks down on uncertainty cues: a human stenographer marks [inaudible], whereas an AI scribe prints an invented neuro exam in the same authoritative font as measured vitals. See why ChatGPT makes things up.

Four exam-room triggers drive most clinical AI scribe errors:

1. History-to-exam promotion: "My right ankle bends fine" becomes Objective: "Right ankle: no edema, full active and passive range of motion."
2. Negation inversion: Cross-talk during review of systems ("Any chest pain, fevers?" / "No, just a cough") drops the "no" and logs "Reports chest pain."
3. Dose and drug swaps: Holding lisinopril 20 mg below SBP 100 while continuing amlodipine 5 mg merges into "Discontinue amlodipine 20 mg."
4. Retracted-plan persistence: A steroid taper mentioned early and ruled out after checking an HbA1c lab value stays in the final Plan.

What clinical audits actually found inside commercial AI scribe notes

Independent clinical audits from 2024 through 2026 expose a sharp gap between burnout polls and chart accuracy: clinicians value finishing notes on time, yet verified errors still appear in 11.5% to 31.3% of audited ambient records.

Health-system releases highlight burnout relief. In The Permanente Medical Group's 10-week rollout across 3,442 physicians and 303,266 encounters (Tierney et al., NEJM Catalyst, Feb 21, 2024), informaticists still documented hallucinations in audited samples, including a fabricated prostate-exam plan and misattributed hand-foot-and-mouth symptoms. In a 2025 JAMA Network Open survey (n = 264 Mass General Brigham respondents and n = 62 Emory respondents), burnout fell by 21.2% among MGB survey respondents and 30.7% among Emory survey respondents (Powers Health, Aug 21, 2025), while Beth Israel Lahey Health reported 89% satisfaction among 1,000 surveyed trial providers and a 74% survey drop in after-hours charting (Business Wire, Apr 28, 2026).

Fast relief invites automation bias. Line-by-line chart audits against visit audio tell the safety story:

Compare those figures with general office transcripts in can you trust AI meeting notes and how often AI is wrong. A 5.3% serious-error rate across audited records means a clinician seeing 20 patients a day faces roughly one serious documentation error per clinic session.

How unperformed exam lines trigger False Claims Act upcoding and malpractice exposure

Signing an AI-drafted note containing physical-exam maneuvers you never performed or medical decision-making you never conducted exposes both clinician and clinic to federal False Claims Act liability (31 U.S.C. § 3729), payer recoupments, and courtroom impeachment.

1. Federal False Claims Act and upcoding (31 U.S.C. § 3729)

Under 31 U.S.C. § 3729(a)(1), billing Medicare, Medicaid, or Tricare with "reckless disregard" or "deliberate ignorance" of chart truth carries treble damages plus civil penalties above $13,900 to $27,800 per false claim (US Code 31 U.S.C. § 3729). Even under CMS Medical Decision Making (MDM) coding (99202 to 99215), two AI scribe habits manufacture billing exposure:

• Inflated MDM: Promoting casual chat about a stable past issue into "Chronic illness with exacerbation managed," or keeping a ruled-out drug in the Plan, upcodes a routine 99213 into 99214 or 99215.
• Unperformed exam attestations: Specialty consults, preventive exams, and imaging or DME prior authorizations often require documented objective maneuvers (straight-leg raise, pedal pulses). Attesting to unperformed exams wrecks Recovery Audit Contractor (RAC) defensibility.

2. Malpractice impeachment and California AB 3030

If a back-pain patient keeps coat and shoes on during a brief refill visit and develops cauda equina syndrome 48 hours later, a signed AI line reading "Motor strength 5/5 bilateral lower extremities, gait normal" traps you at deposition: claiming you did the exam fails against rooming logs, and blaming the AI admits signing a chart unread. Vendor terms classify outputs as drafts and shield the vendor.

Unchecked Plan text also hits patient portals immediately under Cures Act rules (45 CFR Part 171) (HealthIT.gov), while California AB 3030 (effective January 1, 2025) mandates AI disclosures on clinical patient messages unless reviewed first by a licensed human provider (California AB 3030). See AI scribes, patient consent, and visit-note corrections.

How medical assistants, nurses, and clinicians split a 90-second review

Most physician training frames scribe verification as a solo chore at 8:00 PM, overlooking medical assistants (MAs) and nurses who room patients and maintain discrete EHR intake data.

Scope-of-practice lines stay strict: an MA or nurse never edits or signs a physical exam or Assessment and Plan, but anchors discrete vitals, allergies, meds, and consent before the scribe runs. On a 20-patient day (assumptions stated), batch-skimming 20 notes at 6:30 PM takes 60 minutes or decays into blind signing once morning exam recall fades. Splitting 30 seconds of MA intake grounding with a 90-second immediate bottom-up clinician scan (Plan -> Objective -> Meds -> Allergies/Negations -> Laterality) totals 30 minutes across 20 visits with zero evening backlog.

The ed.cafe 90-Second 5-Field Clinical AI Scribe Sign-Off Check

The ed.cafe 90-Second 5-Field Clinical AI Scribe Sign-Off Check sequences review bottom-up by the five audit failure classes. Post this single page at clinic workstations alongside our pre-send check by output type.

THE ED.CAFE 90-SECOND 5-FIELD CLINICAL AI SCRIBE SIGN-OFF CHECK
Operational Aid Only - Not Clinical Practice Advice or Legal Counsel
Follow Institutional Medical-Staff Bylaws & Scope-of-Practice Rules

PART A: ROOMING STAFF PRE-CHECK (MA / LPN / RN - 30 Seconds Before Scribe Runs)
[ ] 1. CONSENT CONFIRMED: Verbal (and state-required written) patient + companion
       consent obtained BEFORE starting audio. If declined -> Scribe stays OFF.
[ ] 2. DISCRETE ALLERGIES & MEDS UPDATED: Update structured EHR allergy and med
       tables directly so the signing clinician has a ground-truth anchor.
[ ] 3. MULTI-SPEAKER FLAG: Alert clinician if a caregiver, child, or medical
       interpreter is in the room (elevated speaker-attribution swap risk).

PART B: SIGNING CLINICIAN 90-SECOND REVERSE SCAN (Run BEFORE Next Door)
Scan BOTTOM-UP while your hands-on exam is still in 2-minute working memory:

[FIELD 1 - 20 sec] RETRACTED PLANS & PATIENT INSTRUCTIONS (Plan / AVS)
  - Delete any drug, taper, lab, imaging order, or referral discussed early
    in the visit and later ruled out.
  - Confirm conditional holds ("Hold drug X if SBP < 100") match discrete orders.
  - Personally read any AI-drafted After-Visit Summary or portal message (CA AB 3030).

[FIELD 2 - 25 sec] OBJECTIVE EXAM vs. SPOKEN HISTORY (Physical Exam Block)
  - HANDS-ON RULE: Delete EVERY organ system or maneuver you did not physically
    inspect, palpate, percuss, auscultate, or observe today.
  - Fix "History-to-Exam Promotion": move spoken patient claims ("knee bends
    fine") out of Objective and back into HPI.
  - Telehealth check: Strip impossible auscultation, palpation, or pulse lines.

[FIELD 3 - 20 sec] MEDICATIONS, DOSES & HOLD/STOP ORDERS
  - Match every prose drug name + mg dose + frequency against discrete e-Rx orders.
  - Check multi-drug dose merges (Drug A's name paired with Drug B's mg strength).

[FIELD 4 - 15 sec] ALLERGIES & SYMPTOM NEGATION FLIPS (ROS / HPI)
  - Confirm prose allergies match the discrete EHR allergy banner.
  - Check red-flag negations ("denies chest pain, dyspnea, syncope, self-harm")
    to ensure cross-talk did not drop the word "no."

[FIELD 5 - 10 sec] IDENTITY, ONSET DATES & LATERALITY
  - Verify LEFT vs. RIGHT on every joint, eye, ear, lung, breast, or limb.
  - Confirm family/caregiver diagnoses were not logged as the patient's own PMH.
  - Verify onset duration ("3 days" vs. "3 weeks" vs. "3 months").

PART C: DE-IDENTIFIED VENDOR ERROR LOG (ZERO PHI - Pattern Only!)
Date | Scribe Tool | Setting (Clinic / Video / Interpreter) | Field # (1-5) |
De-Identified Failure Pattern | Escalated to Clinical Informatics / PSO? [Y/N]

Never paste patient names, dates of birth, or medical record numbers into Part C or general IT tickets. Log only de-identified error patterns and route chart-specific events through your privileged Patient Safety Organization (PSO) channel. If an error slips into a signed record, never overwrite locked text; enter a dated Addendum clarifying the record (45 CFR § 164.526) (eCFR § 164.526) and alert billing compliance if E/M coding or prior authorization was affected. Compare vendor audit questions in questions to ask an AI vendor or visit the ed.cafe Staff Room.

Where this stops being true

Operational checklists hit limits where compliance officers, informaticists, and counsel must take over:

• Not clinical or legal advice: General documentation-safety workflows only; follow clinic bylaws, payer coding rules, and counsel.
• High-acuity and multi-party rooms: Trauma bays, multi-relative pediatric visits, and 42 CFR Part 2 substance-use visits (see AI for case notes under HIPAA and Part 2) need specialized workflows.
• Order-staging integrations: Scribes that pre-stage prescriptions, labs, or billing codes require local clinical-informatics validation before use.
• Model drift: Published error rates (n = 565 and n = 356 records) reflect point-in-time tests; silent model swaps shift failure modes overnight.

Questions people ask

Key terms

• Ambient AI scribe: Exam-room software capturing visit audio to draft clinical notes via speech recognition and language models.
• History-to-exam promotion: Failure placing spoken patient claims inside the Objective physical-exam block as if inspected hands-on.
• Automation bias: Over-trusting smooth machine prose, ranked by ECRI among top health-tech hazards in 2025 and 2026.
• False Claims Act (31 U.S.C. § 3729): Federal statute imposing treble damages and per-claim penalties for government bills backed by reckless chart falsehoods.
• California AB 3030: California law (Jan 1, 2025) requiring AI disclosures on clinical patient messages unless reviewed by a licensed provider.
• HIPAA Addendum (45 CFR § 164.526): Dated correction appended to a locked medical record without erasing audit history (60-day response rule).

Sources

1. Australian Doctor, "Doctors using AI scribes say hallucinations are frequent: a non-existent neurological exam is just one example" (2025): Australian Doctor
2. Fox et al., "Auditing Commercial Ambient Clinical Scribes" (n = 565 records, NeurIPS 2026): NeurIPS 2026 Virtual
3. UC Davis Health / JMIR Medical Informatics, "Pragmatic Evaluation of Ambient AI Clinical Documentation" (n = 356 records, 2026): JMIR Med Inform PDF
4. Tierney et al. (The Permanente Medical Group), "Ambient Artificial Intelligence Scribes to Alleviate the Burden of Clinical Documentation" (Feb 21, 2024): NEJM Catalyst
5. ECRI, "Top 10 Health Technology Hazards for 2025: Risks with AI-Enabled Health Technologies" (2025): ECRI News
6. Koenecke et al., "Careless Whisper: Speech-to-Text Hallucination Harms" (Feb 2024): arXiv:2402.08021
7. WBUR, "Artificial intelligence in primary care and patient privacy at Mass General Brigham" (May 5, 2026): WBUR
8. Beth Israel Lahey Health / Business Wire, "BILH Expands Ambient AI Solution Systemwide" (Apr 28, 2026): Business Wire
9. Powers Health (summarizing JAMA Network Open MGB n = 264 and Emory n = 62 survey cohorts), "Note-taking AI reduces doctor burnout" (Aug 21, 2025): Powers Health
10. US Code, "31 U.S.C. § 3729: False Claims" (current): US Code
11. California Legislature, "AB 3030: Health Care Services: Artificial Intelligence" (effective Jan 1, 2025): California Legislative Information
12. ASTP / ONC, "21st Century Cures Act Information Blocking (45 CFR Part 171)" (current): HealthIT.gov
13. eCFR, "45 CFR § 164.526: Amendment of Protected Health Information" (current): eCFR § 164.526