RatedWithAI

RatedWithAI

Accessibility scanner

AI GovernanceSeptember 8, 2026

Your AI Vendor's SLA Measures the One Failure You Do Not Get

Availability clauses count server errors. AI services fail by throttling, slowing down and quietly getting worse — three modes that leave a 99.9% commitment intact while your product stops working.

Throttled
Rate-limit responses are commonly excluded from availability calculations
Slow ≠ down
A six-fold latency increase breaches nothing unless latency is in the SLA
Sole remedy
Credits are capped, claim-gated, and stated to be your only recourse

The Definition Does the Work

Service level agreements were shaped by hosting and traditional SaaS, where the failure being priced was binary: the service responds or it does not. The metric that grew out of that — successful requests over total requests, measured monthly, by the vendor — is a reasonable summary of a binary system.

AI inference is not binary. Capacity is scarce and shared, so the first response to pressure is to shed load through rate limits rather than to fail. Response time varies by an order of magnitude with load and output length. And the quality of what comes back changes when the model behind an endpoint changes, which can happen without any interface change at all. Each of those degrades the product; none of them registers as unavailability under a standard definition.

This is not a bad-faith design. It is a definition inherited from a different failure distribution, applied to a service that fails differently, and it stays in place because the buyer's review checks whether an SLA exists rather than what it measures.

Four Degradation Modes and Where They Fall Out of Scope

Rate limiting and quota throttling

Requests over an account limit return a throttle response, which agreements frequently classify as expected behavior rather than an error, and quotas are typically set in a console rather than the contract.

Why it escapes the SLA: Your effective capacity can be reduced unilaterally and instantly. Nothing breaches, no credit accrues, and the impact reaches production before anyone reads a release note. Fix by naming committed limits in the order form and requiring notice before reduction.

Latency drift

Time-to-first-token and total generation time move with load, with output length, and with routing changes on the vendor side.

Why it escapes the SLA: Interactive features have a usability cliff well before the timeout. If the agreement is silent on latency, a service that answers ten times slower is fully compliant. Fix by adding a percentile commitment — p95 and p99 for a named operation, not an average, which hides exactly the tail that hurts.

Silent quality regression

A model version behind an endpoint is updated or rerouted, and outputs change in ways that no status metric captures.

Why it escapes the SLA: This is the failure with the longest detection delay, because it produces plausible output rather than errors and is usually found by a customer. Fix with version pinning, notice of material behavioral change, and a canary evaluation on your side that runs regardless of what the vendor tells you.

Regional and capacity constraints

Availability is often measured per service and per region, and capacity for a specific model in a specific region can be exhausted while the service overall is healthy.

Why it escapes the SLA: Aggregate measurement across a whole service dilutes an outage that fully covered your deployment. Fix by defining the measurement scope as the service, model and region combination you actually consume, which is the single most useful edit available in most SLA negotiations.

What a Credit Is Actually For

Service credits are frequently misread as compensation. They are better understood as a signal and a paper trail. Four features to check before you spend negotiation capital on the percentage:

  • The claim window. Many schedules require a claim within thirty days with supporting logs. Miss the window and the credit is gone regardless of the breach, which means the operational task is monitoring and filing, not negotiating.
  • Sole and exclusive remedy language. This is the clause that matters more than the amount. Where credits are the exclusive remedy for availability failures, no volume of degradation gets you anything else — unless you also have a termination right tied to repeated failure.
  • The measurement authority. If the vendor's measurements are definitive, your telemetry is context rather than evidence. Ask for mutual measurement or at minimum an obligation to review your data in good faith.
  • Chronic failure escalation. The most valuable term in this section is usually not a credit at all: a right to terminate without penalty after a defined number of monthly misses, plus transition assistance. That is the remedy proportional to the risk.

The AI SLA Negotiation Set

Ordered by how much they change your position, not by how hard they are to get. The first section is where most of the value sits and is also the most frequently omitted.

1. Capacity and Scope
  • State committed rate limits and quotas in the order form, not the console
  • Require notice before any reduction in committed capacity
  • Define measurement scope as your service, model and region combination
  • Define whether throttled requests count toward availability — the default is usually no
  • Agree a path and lead time for capacity increases ahead of a known launch
2. Performance Definitions
  • Add p95 and p99 latency commitments for named operations, not averages
  • Separate time-to-first-token from total generation time for streaming use cases
  • Set the measurement interval short enough to catch real incidents, not monthly aggregate only
  • Enumerate the exclusions and check each against a plausible incident
  • Require incident notification within a defined period, with a written post-incident report
3. Model Stability
  • Secure the right to pin a named model version for a defined term
  • Require advance notice of deprecation, sized to your revalidation cycle
  • Require notice of material behavioral change to a pinned version
  • Keep prior-version access available during the transition window
  • Reserve the right to re-run your evaluation set before any forced cutover
4. Remedies and Exit
  • Negotiate termination for chronic failure, defined by count of monthly misses
  • Check whether credits are the sole and exclusive remedy and what that forecloses
  • Automate credit claims so the filing window is never the reason you recover nothing
  • Require transition assistance and data return in a machine-readable format
  • Keep a fallback provider integrated and periodically exercised, not merely identified

Frequently Asked Questions

We are on standard self-serve terms with no negotiation possible. What can we still do?

Everything on your own side of the boundary, which is more than it sounds. Instrument the calls: per-request latency percentiles, response codes broken out so throttles are visible separately from errors, and a scheduled canary evaluation whose outputs you score and retain. Build the fallback path and exercise it on a schedule, because an untested failover is a plan rather than a capability. Degrade gracefully in the product — a queued result with an honest message costs less than a spinner that never resolves. Then size your exposure: if a service with no meaningful remedy sits in a revenue path, that is a business decision to make deliberately at a known price, not a contract problem to solve.

Does a higher spend tier actually get better SLA terms?

Commonly yes, and the improvements tend to arrive in a predictable order. Committed capacity and higher rate limits come first because they cost the vendor least. Then measurement scope narrowed to your deployment, then latency commitments, then version pinning and deprecation notice, and last of all anything touching the exclusive-remedy language, which vendors defend hardest because it bounds their total exposure. If you are approaching a renewal with growing volume, ask in that order rather than opening on the credit percentage — capacity and version stability will do more for your uptime than any credit schedule will.

How do we decide whether to build multi-provider failover?

Compare the cost of maintaining a second integration against the revenue at risk during a plausible multi-hour degradation, and be honest that the maintenance cost is ongoing rather than one-time — prompts, output shapes and evaluation results all diverge across providers, so a fallback that is never exercised will not work when called. Where a workflow is asynchronous or internal, queueing and retry usually beat a second provider. Where an interactive revenue path depends on the call, the second integration pays for itself the first time it is used. The intermediate option that is often correct: keep the second provider integrated behind a flag, run a small share of traffic through it continuously so it stays correct, and accept a quality difference during failover as the price of continuity.

The vendor excludes beta and preview features from the SLA. Does that matter?

It matters more in AI procurement than elsewhere, because the feature you built on is disproportionately likely to be labelled preview and to stay that way for a long time. Preview status typically removes availability commitments, support response times and often the deprecation notice period simultaneously, so a production dependency on a preview endpoint has no service commitment at all. Inventory which of your dependencies are in preview, record it as a known risk with an owner, and ask at each renewal for a general-availability timeline. If a core workflow rests on a preview capability with no timeline, that is worth surfacing to whoever owns the revenue, because the remediation is a product decision rather than a legal one.

Is uptime even the right metric to track for an AI feature?

It is necessary and far from sufficient. The metric that predicts user complaints best is usually a composite: successful completion of the workflow within a latency budget, at an output quality above a threshold you defined. That means tracking completion rate rather than response rate, latency at the tail rather than the mean, and a periodic quality score from a canary set. Track those three and you will detect nearly every degradation your users would notice, including the ones the vendor's status page will never show. It also gives you the artifact that makes an escalation productive — a dated series showing exactly what changed and when, rather than a report that the tool feels worse this week.

Measure Before You Negotiate

A renewal conversation backed by three months of your own latency percentiles, throttle rates and canary scores is a different conversation than one backed by an impression. The telemetry is cheap, it takes effect immediately, and it does not require anyone's agreement.

Start the measurement now so the data exists when the leverage does. Contract terms you can only argue for in the abstract are the ones you do not get.