RatedWithAI

RatedWithAI

Accessibility scanner

Algorithmic DiscriminationJuly 21, 2026

AI Prior Authorization Denials and Discrimination Risk

Insurers are using AI to review and deny prior authorization and post-acute care requests at scale. The pattern drawing lawsuits and new state laws: high algorithmic denial rates, an even higher reversal rate on appeal, and disproportionate impact on elderly and disabled patients who rarely appeal.

Human Review
CMS requires clinician sign-off on Medicare Advantage AI denials
Disparate Impact
Models trained on average recovery timelines flag atypical-but-valid cases
Rising
State laws mandating licensed clinician review before AI denials finalize

How AI Entered Utilization Review

Prior authorization and utilization review — the process by which an insurer approves or denies coverage for a requested treatment, procedure, or continued care — has become one of the most heavily AI-automated functions in health insurance. Predictive models estimate expected recovery timelines, flag claims that deviate from statistical norms, and route cases toward automated denial or accelerated approval.

The efficiency case is real: manual review of every claim doesn't scale. The problem is what happens when the model's statistical "normal" doesn't match an individual patient's actual clinical need — and who bears the cost of that mismatch.

Why the Impact Concentrates on Specific Populations

AI utilization-review models are typically trained on historical claims data reflecting average length-of-stay and recovery timelines across a broad patient population. That training approach systematically disadvantages patients whose legitimate recovery needs deviate from the average — which is not a random distribution.

Elderly patients recovering from surgery or injury

Recovery timelines longer than the population average are flagged as 'excessive length of stay' even when clinically appropriate for age-related healing rates

Patients with disabilities or chronic comorbidities

Baseline health status differs from the 'typical' patient the model was trained against, producing systematically inaccurate predictions for this group specifically

Rural or under-resourced patients

Fewer alternative care options mean a denial has outsized practical impact, and lower appeal rates mean fewer opportunities to correct algorithmic errors

Patients in typical health with standard recovery patterns

Lower risk profile — algorithmic predictions are most accurate for patients closest to the population average used in training

The legal exposure isn't that the model is inaccurate in isolated cases — every predictive model has an error rate. It's that the errors cluster predictably in protected or historically vulnerable populations, which is the classic pattern underlying disparate-impact claims even without any intent to discriminate.

The Legal Landscape Shifting Under Payers

1

CMS human-review requirement for Medicare Advantage

Federal rules require that AI tools used in Medicare Advantage coverage determinations cannot be the sole basis for a denial. A physician or appropriate clinical staff must make the final determination based on the individual patient's circumstances, not just the algorithm's output.

2

State laws mandating licensed clinician sign-off

A growing number of states have enacted or introduced legislation requiring that AI-flagged denials in commercial and Medicaid managed-care plans receive review by a licensed clinician with relevant specialty expertise before the denial is finalized — closing a gap CMS rules don't reach.

3

Litigation building on reversal-rate evidence

Lawsuits against major insurers over AI-driven post-acute-care denials have centered on internal data showing extremely high reversal rates when patients successfully appeal — used as evidence that the algorithm was systematically wrong and deployed anyway because appeal rates are low.

4

Disability and age discrimination theories layered on top

Beyond contract and bad-faith claims, plaintiffs are increasingly framing algorithmic denial patterns as disparate-impact discrimination under disability rights and age discrimination statutes when the burden falls predictably on those populations.

What Payers and Health-Tech Vendors Must Document

Required documentation
  • Which clinical criteria the AI system applied to each flagged case
  • Evidence a qualified clinician independently reviewed the case, not just approved the algorithm's recommendation
  • The individual patient's clinical facts actually considered, beyond the statistical baseline
  • Model error and appeal-reversal rates, tracked and available for audit
  • Whether the model's training data reflects the demographics of the population it's applied to
Common compliance failures
  • Clinician 'review' that consists of approving the algorithm's output without independent assessment
  • No tracking of reversal-on-appeal rates, or rates tracked but not acted on
  • Denial letters that don't disclose AI involvement in the determination
  • No demographic breakdown of who gets denied, making disparate impact invisible internally
  • Vendor contracts that don't require the AI system's accuracy data to be shared with the payer

Compliance Checklist

  • Confirm no AI-flagged denial finalizes without documented, independent clinician review
  • Track model reversal-on-appeal rates and review them for patterns concentrated in specific patient groups
  • Audit training data for demographic representativeness relative to the covered population
  • Disclose AI involvement in denial determinations in patient-facing notices where required
  • Require health-tech vendors to share accuracy and error-rate data as a contract term
  • Review state-specific AI utilization-review laws applicable to each plan's operating states
  • Build an internal escalation path for patients or advocates who flag a suspected pattern of unfair denials

Frequently Asked Questions

Does the CMS human-review rule apply to commercial insurance, not just Medicare Advantage?

The federal CMS rule specifically governs Medicare Advantage plans. Commercial and Medicaid managed-care plans fall under whatever state law applies, which increasingly mirrors the same human-review principle but varies significantly by state — some states have no equivalent requirement yet.

Is a high AI denial-reversal rate itself illegal?

Not automatically, but it's powerful evidence in litigation and regulatory review. A pattern of frequent reversals on appeal suggests the initial algorithmic determination was systematically inaccurate, which undercuts a payer's defense that AI-assisted denials reflect sound medical necessity review.

What should a patient do if they suspect an AI system unfairly denied their claim?

Request the specific clinical criteria used in the denial and ask explicitly whether AI was involved in the determination — an increasing number of states require this disclosure. File a formal appeal with supporting clinical documentation from the treating physician, since low appeal rates are part of why these systems persist unchecked.

The Documentation Standard Is Rising Fast

Regulators and courts are converging on the same requirement: an algorithm can inform a coverage decision, but it cannot be the decision, and payers need to prove a human actually looked at the individual patient's facts.

Track your model's error and reversal rates now, before litigation or an audit forces you to produce them under pressure.