The Symptom Checker Made a Clinical Decision
Automated triage is the highest-leverage feature in telehealth and the one with the least settled legal footing. It runs before anyone is licensed to do anything, it operates in fifty regulatory environments at once, and its output — an urgency level, a routing decision, a "you should see someone today" — is exactly the kind of personalised direction that practice acts were written to govern.
Four Positions on One Spectrum
"Is this the practice of medicine" is not a yes/no question about a product category. It is a question about a specific output, and the same codebase can produce outputs at four different points on the spectrum depending on how the response is worded.
The governance problem is that the position on this spectrum is set by generated language, not by an architecture decision. A prompt change, a model upgrade, or a helpfulness tuning pass can move a product from the second row to the third without a single ticket saying so. Whatever review process you have for clinical scope has to be attached to the prompt and model configuration, because that is where the scope actually lives.
Fifty Jurisdictions, One Product
Telehealth licensure generally keys to the patient's location at the time of the encounter. For a national platform that means the practice act, board guidance, consent rules, and AI-disclosure statutes of every state the product is available in apply simultaneously. Interstate compacts ease clinician licensing in participating states but do not resolve the antecedent question of whether the automated step needed a licensed person at all. The workable posture is to identify the most demanding requirement in each category — disclosure wording, consent timing, documentation, escalation — and implement to that everywhere, rather than maintaining fifty conditional flows nobody can test.
What Informed Consent Has To Cover Now
Human Oversight, and How It Fails
Human-in-the-loop is the standard answer to every question in this article, and it is a good answer when it is true. It stops being true in predictable ways: the reviewer is not licensed in the patient's state; the queue is sized so that meaningful review is impossible; the interface presents the model's recommendation as a default with a single approve button; the override rate sits near zero and nobody has looked at it in a year.
Measure the override rate and the time-per-review, and treat both as compliance metrics rather than efficiency metrics. If overrides approach zero, either the model is remarkable or the review is nominal, and only one of those explanations survives cross-examination. The same automation-bias pattern shows up in automated claims adjudication, where the review-rate evidence has already proved decisive.
The Structural Question Investors Ask Late
In corporate-practice states, clinical services are delivered through a professional entity while the technology company provides management services. The doctrine asks who controls clinical judgement. When the triage model's thresholds, escalation rules and prompt behaviour are set by the management company's engineers, the honest answer is uncomfortable — the services agreement says the professional entity controls clinical decisions, and the configuration file says otherwise. The mitigation is governance that matches the paperwork: clinical leadership with documented authority over model thresholds, a change process that requires their sign-off, and records showing it was exercised. This is the same non-delegable-control problem examined in our healthcare AI privacy overlap guide, arriving from the licensing side instead.
Frequently Asked Questions
Is an AI symptom checker practising medicine?
It depends on the output, not the product category. General health information is outside practice acts; personalised, directive statements about a specific person's condition or the care they should seek move toward the conduct those acts govern — including the 'holding out as able to diagnose' limb, which does not require the diagnosis to be correct or even given.
Which state's rules apply to a national telehealth product?
Generally the state where the patient is located during the encounter. A nationally available tool is therefore subject to every state's requirements at once. Build to the most restrictive standard across disclosure, consent, documentation and escalation rather than maintaining per-state variants.
Must we disclose that a patient is interacting with AI?
In a growing number of states, yes, with healthcare-specific provisions in several of them. Disclose at the point of interaction rather than only in a consent document, identify which parts of the encounter are automated, and keep a record of the wording used for that session.
Does adding a clinician reviewer make triage compliant?
Only where the review is substantive: the reviewer is licensed in the patient's state, sees enough context to form an independent judgement, has realistic time to do so, and can override without friction. Track override rates and review duration — those numbers, not the org chart, are what establish whether oversight existed.
What are the biggest documentation gaps in AI triage?
The model or configuration version applied to the encounter, the consent text actually shown, the input the system received, the recommendation it produced, and whether a human changed it. Most platforms retain the clinical note and none of the five, which makes the encounter impossible to reconstruct later.
How does corporate practice of medicine apply to the model itself?
In corporate-practice states the concern is control over clinical judgement. Where a lay-owned management entity sets triage thresholds and escalation logic, it is exercising control that the structure allocates to the professional entity. Give clinical leadership documented, exercised authority over those settings so the governance matches the agreement.
Pull the Override Rate This Week
Before any policy work, run one query: what percentage of AI triage recommendations did a clinician change, and how long did the median review take? Those two numbers decide whether your human-in-the-loop defence is real or a diagram, and you already have the data to answer them.
If the answer is uncomfortable, fix the queue sizing before you fix the consent language. The paperwork cannot cure a review that isn't happening.