RatedWithAI

RatedWithAI

Accessibility scanner

Algorithmic DiscriminationSeptember 2, 2026

Screening Is Watched. The Model That Decides Who Stays Is Not.

Tenant screening has had years of scrutiny, litigation and vendor disclosure. The systems that score renewal risk, flag lease violations from sensor and ticket data, and queue accounts for filing operate on residents who already live in the building — and they run with far less governance, on far messier data, with the housing provider squarely as the decision-maker.

Same statute
Terms, conditions and privileges of a rental are covered, not just admission
Outputs, not inputs
Removing protected variables does not remove disparate impact exposure
A score is not a cause
Just-cause notices need a stated, real ground the model cannot supply

Four Systems, One Legal Question

Post-move-in automation arrives piecemeal, which is why it is rarely governed as one thing. In a typical mid-sized portfolio you will find some combination of:

  • Renewal risk scoring — a model ranking which residents to renew, at what increase, and which to let lapse.
  • Automated violation detection — noise sensors, smart-camera analytics, package and access logs, parking recognition, or text classifiers running over maintenance tickets and resident messages.
  • Delinquency and filing workflows — rules that escalate an account through notice, late fee and filing on a schedule with no human decision point.
  • Communication triage — an assistant deciding which resident messages are urgent, which get a template, and which are closed.

Each looks like operations. Together they determine who keeps their housing, which is the question the Fair Housing Act asks about. And unlike screening, there is no applicant-facing vendor in the middle — the decision, and the notice with your name on it, is yours.

Why Neutral Features Do Not Protect You

The standard reassurance is that the model never sees race, familial status, national origin or disability. Disparate impact analysis does not care. It asks whether a facially neutral practice produces a discriminatory effect, whether the practice serves a substantial, legitimate, non-discriminatory interest, and whether a less discriminatory alternative would serve that interest.

Run that against the features these models actually use. Late-payment counts track income volatility and payday timing. Maintenance ticket volume tracks unit age and household size. Noise and guest-activity signals track family composition, multi- generational households and caregiving. Complaint counts track the prejudices of neighbours. None of these are protected characteristics; all of them are correlated with some, and the model's job is precisely to find and exploit correlation.

The third step of the analysis is the one operators most often lose. Even where the interest is legitimate, a cheaper and less discriminatory alternative that serves it undermines the defence — and in this domain there usually is one, because a rule keyed to a single concrete fact almost always outperforms a composite score on defensibility.

The Accommodation Collision

This is the failure mode that turns an ordinary compliance question into a case with a named plaintiff. Reasonable accommodation duties mean certain conduct that looks like a lease violation is protected: an assistance animal in a no-pet building, a caregiver whose visits exceed the guest policy, mobility equipment stored where policy forbids, behaviour associated with a psychiatric disability.

An automated pipeline does not know any of that unless someone built the gate. What it does is detect, flag, escalate and generate a notice — to a resident whose accommodation request is already in your system. The document produced is dated, specific and discoverable, and it is very hard to characterise as an isolated staff error when it was generated by a rule you configured.

Accommodation status has to function as a hard interlock: no automated notice, no automated escalation, no automated non-renewal on a resident with a pending or granted accommodation, until a person who knows the file has reviewed it.

Just Cause and the Pretext Trap

A growing number of jurisdictions require a stated, permitted ground for eviction or non-renewal. That requirement interacts badly with score-driven decisions in a specific way: if the real reason is the score, and the notice states a permitted ground selected afterward to fit, you have created a pretext record.

Pretext claims are easier to prove than disparate impact and they play worse in front of a factfinder. The internal artefacts — a queue ordered by risk score, a note reading "flagged for non-renewal", a template selected by the system — are exactly what discovery is aimed at. The operational rule that follows is simple: the ground stated in the notice must be the ground that actually drove the decision, and it must be documented independently of any model output.

What a Defensible Process Looks Like

  1. Inventory every system that touches a resident outcome. Including the ones bought as building operations rather than as decisioning — sensors, access control, ticket triage. You cannot test what is not on a list.
  2. Measure outcome rates, by property. Non- renewal, filing and fee rates by protected class where you can lawfully estimate it, and by proxy geography where you cannot. Portfolio averages hide the property where the problem lives.
  3. Require a concrete predicate for any adverse action. A specific missed payment, a specific documented violation with a date. A score may prioritise attention; it must not be the reason.
  4. Gate on accommodation status and on language access. Both as hard blocks on automation, not as review steps someone is supposed to remember.
  5. Keep the human review real. A reviewer who approves ninety-nine percent of queued actions is documenting rubber-stamping. Measure override rates and treat a near-zero rate as a finding.
  6. Test the less discriminatory alternative explicitly. Compare your model against a simple, transparent rule on both business outcome and disparity. If the simple rule is close, the model is hard to justify and easy to attack.
  7. Retain the decision record. Inputs, version, score, reviewer, stated ground, outcome. The claim will be filed long after your log rotation would otherwise have discarded all of it.

Common Questions

We only use the score to prioritise outreach, not to decide. Is that safe?

Safer, and worth writing down. But prioritisation has effects too: if the score decides who gets a payment-plan call and who gets a notice, it is allocating a benefit. Test outreach allocation for disparity the same way you test outcomes, and make sure the operational reality matches the policy — 'prioritisation only' stops being true the moment staff treat the ranking as the answer.

Does this reach small landlords with a few units?

The Fair Housing Act reaches most housing providers, with narrow exemptions that do not cover the typical small portfolio using property management software. What changes with size is not liability but capacity to test — which is an argument for simple, documented rules rather than a purchased score you cannot audit.

Our software vendor sets the escalation rules by default. Whose problem is that?

Yours in the first instance, because the notice comes from you and the resident's counsel names you. Vendor exposure has been actively litigated and is not a settled shield either way. Practically: get the default rules documented, change the ones you cannot defend, and put testing cooperation in the contract at renewal.

Can AI-generated resident communications create exposure on their own?

Yes, in two ways. Tone and content that vary by resident segment can constitute different terms and conditions. And a system that handles English-language messages well while mishandling others creates a language-access disparity that shows up in outcomes without anyone intending it.

How far back do we need to keep records?

Longer than a default retention setting. Fair housing claims arrive well after the decision, and the material that exonerates a defensible decision — the concrete predicate, the reviewer's note, the model version — is the first thing a ninety-day rotation deletes. Set retention against the limitations period, not against storage cost.

What is the single highest-value change?

Requiring a specific, documented, human-verified fact before any adverse action, and never letting a composite score serve as that fact. It resolves the pretext problem, the just-cause problem and most of the accommodation problem simultaneously, and it is a process change rather than a modelling project.

Residents and Regulators Read Your Site First

Your resident portal, application flow and policy pages are the public record of how you make housing decisions — and they are what AI assistants quote when a prospective resident or an advocate asks about your properties.

Run a free scan of your site to see what your pages currently say about your process.