RatedWithAI

RatedWithAI

Accessibility scanner

Algorithmic DiscriminationAugust 24, 2026

The Onboarding Bot That Asks for One More Document

Hiring-bias work stops at the offer. Then a different system takes over: identity verification, document capture, employment-eligibility checks. It rejects documents, requests substitutes and flags names for review — and it does all of it the same way every time, which is what makes a pattern out of what used to be an individual mistake.

Worker's choice
The law lets the worker pick which acceptable documents to present
Second ask
A prompt for another document is a documentary demand, not a UX step
Override rate
If human review overturns almost nothing, the model is deciding

Why Onboarding Fell Outside the Bias Programme

Every AI-hiring compliance effort of the past several years has been organised around selection: who gets screened out, who gets ranked, who gets the interview. Verification sits after the decision, so it was classified as administration. The tools were bought by HR operations or IT to reduce fraud and speed up day-one paperwork, and they were never entered on the register of automated employment decision tools.

The classification is wrong on its own terms. A worker who cannot clear verification does not start, which is an adverse employment outcome produced by an automated system. And the legal regime that governs this stage is not the general discrimination statute most teams know — it is a specific prohibition on documentary practices, where the violation is the request itself rather than the eventual outcome.

That distinction matters enormously for exposure. You do not need a rejected worker to have a claim. Asking a lawfully authorised worker for more or different documents than required, because of their citizenship status or national origin, is the violation — even if they produce the document and start on Monday.

Four Places the Tool Creates the Claim

Asymmetric document confidence

Document-authentication models are trained and tuned on the document types they see most: state driver's licences and passports from a handful of issuing authorities. Permanent resident cards, employment authorization documents, foreign passports with endorsements and less common state IDs are rarer in training data and in template libraries, and they score lower.

Why it creates exposure: A lower score triggers a rejection or a request for an alternative. The workers presenting those document types are disproportionately non-citizens, so a uniform confidence threshold produces a status-correlated documentary demand without anyone deciding to make one.

Over-documentation prompts in the flow

Product design encourages collecting more than the minimum: an optional social security number field, a prompt to add a second document 'to speed up verification', a pre-selected document type in a dropdown, or a flow that asks immigration-status questions before establishing what documents are being presented.

Why it creates exposure: Requesting more or different documents than required, or specifying which documents the employer prefers, is precisely what the unfair documentary practice rules prohibit. A default selection in a dropdown is a specification, and a persuasive prompt is a request.

Name, script and transliteration handling

Matching engines compare the name on the document to the name in the applicant record. Multiple surnames, patronymics, diacritics, non-Latin scripts, transliteration variants and hyphenation produce mismatches that have nothing to do with identity, and downstream systems truncate or reorder fields inconsistently.

Why it creates exposure: A name mismatch usually routes to manual review or a re-submission request. The failure rate is concentrated among workers with non-Anglophone naming conventions, which is national-origin correlation appearing as a data-quality issue.

Biometric selfie matching

A live selfie is compared to the photo on the presented document, and a similarity threshold decides. Documented performance differences across skin tone, age and gender mean a single threshold yields unequal false-rejection rates across populations.

Why it creates exposure: Beyond the discrimination exposure, capturing and comparing facial geometry is biometric processing with its own consent, notice, retention and destruction requirements — and a private right of action with per-violation damages in the most litigated state.

The Number Nobody Computes

Ask a verification vendor for accuracy and you will get a single figure in the high nineties. That number is designed to end the conversation. The figure that determines your exposure is the first-pass acceptance rate segmented by the document type the worker chose to present, and it is computable entirely from your own logs.

  • First-pass acceptance by document type.Group by what the worker presented — licence plus social security card, US passport, permanent resident card, employment authorization document, foreign passport with endorsement — and compute how often verification cleared without a further request.
  • Additional-document request rate. How often did the flow ask for something more? This is the metric that maps directly onto the prohibited practice, and it is usually not instrumented at all because product telemetry treats a re-upload as a funnel event rather than a legal one.
  • Manual review entry and override rate. Who gets routed to a human, and how often does the human disagree with the machine? A near-zero override rate tells you the review is ceremonial.
  • Time to complete onboarding. Even where everyone eventually clears, a systematically longer path for one population is a disparity — in start dates, in first paycheques, and in the experience of being treated as suspect on day one.
  • Abandonment. Workers who never complete verification disappear from the funnel and from the analysis. They are the population most likely to have been effectively excluded, and the least likely to be counted.

Designing the Human Step So It Does Something

If a person is going to review flagged documents, the review has to be built to produce independent judgment. That means showing the document before the model's verdict rather than after, removing throughput from the reviewer's performance measures for this queue, making an override a single documented action rather than an escalation, giving reviewers explicit written authority to accept any document that reasonably appears genuine regardless of the score, and tracking override rates as a system-health metric that gets attention when it approaches zero.

The Verification Compliance Checklist

Run this against every identity, document and employment-eligibility tool in the onboarding path, including modules bundled inside your HR platform that were never procured separately.

1. Flow Design
  • Present the full list of acceptable documents with no default selection and no preferred option highlighted
  • Remove prompts suggesting additional documents would speed up or strengthen verification
  • Do not ask about citizenship or immigration status before the worker has chosen what to present
  • Make optional fields visibly optional and stop collecting identifiers you do not need
  • Apply an identical flow to every worker regardless of document type presented
2. Measurement
  • Compute first-pass acceptance rate by document type presented, every quarter
  • Instrument and track the additional-document request rate as a distinct event
  • Track manual review entry rate and reviewer override rate by document type
  • Measure time to onboarding completion and abandonment by document type
  • Investigate any segment materially below the highest-performing group rather than explaining it
3. Human Review
  • Show reviewers the document before revealing the model score
  • Grant written authority to accept documents that reasonably appear genuine, over a low score
  • Remove throughput targets from this review queue and audit for anchoring
  • Log every flag, reason code, reviewer decision and override with the model version
  • Provide workers a documented path to contest a rejection and re-present the same document
4. Biometrics and Vendors
  • Obtain written consent before any facial capture and publish the retention and destruction schedule
  • Provide a non-biometric verification alternative that does not disadvantage the worker
  • Require vendor performance metrics disaggregated by document type and demographic group
  • Document your tenant's threshold settings and require notice of model or threshold changes
  • Secure audit rights and retain records for the full statutory period, including the flag logs

Frequently Asked Questions

The system does not reject anyone — it just asks for another document. Is that really a problem?

That is the problem, specifically. The prohibition on unfair documentary practices reaches the request, not only the outcome: demanding more or different documents than required, or specifying which documents you will accept, is the violation even when the worker complies and is hired. So a flow that quietly asks a subset of workers for a second document has produced a completed violation for each of them, at scale, with a timestamped record in your own system. It is also worth noticing what the pattern feels like from the other side — being asked to prove yourself twice on your first day at a job you were already offered is precisely the experience the rules exist to prevent, and it is the kind of thing people tell someone about.

Our vendor is certified and widely used. Doesn't that provide some protection?

It provides a procurement justification, not a legal defence. Certifications in this space generally attest to security controls or to accuracy against a benchmark dataset, neither of which speaks to how your configuration performs across your applicant population. Popularity is similarly beside the point; a widely deployed system with a status-correlated failure mode is a widely distributed problem rather than a safe harbour. The enforcement posture in this area has been consistent for years: the employer holds the verification obligation and the employer acted on the result. Use the vendor relationship to obtain the disaggregated metrics, threshold documentation and audit rights that would let you demonstrate you monitored the tool — that evidence is worth considerably more than the certificate.

How does this interact with remote document examination?

Remote examination raised the stakes because it inserted software between the examiner and the document. When an authorised representative physically inspected a document, the standard was whether it reasonably appears genuine to a person. In a remote flow, an image passes through capture guidance, compression, glare and edge detection before any human sees it, and an automated authenticity score frames what the human concludes. Documents with holographic overlays, unusual dimensions or non-standard photo placement are disproportionately affected by that pipeline, and those characteristics correlate with document type. If you use remote examination, retain the captured images and the reason codes, and check whether capture-quality failures cluster by document type — a capture problem misread as an authenticity problem is a common and entirely findable defect.

What is the fastest audit we can run this quarter?

Pull the last twelve months of onboarding records and answer three questions. How many workers were asked for a document beyond their initial presentation, and what did they present first? How many were routed to manual review, and what fraction of those flags were overturned? How many started verification and never completed it? You do not need statistical sophistication to interpret the answers — if the additional-document rate for workers presenting immigration documents is visibly higher than for workers presenting a licence and social security card, that is the finding, and it is a configuration and flow-design fix rather than a model project. Write the analysis down with a date on it, because a documented monitoring practice is itself part of the defence.

Can we just keep a human doing all verification manually instead?

You can, and for low-volume hiring it is a defensible choice, but it is not automatically safer. Manual verification has its own well-documented failure mode: individual examiners asking for extra documents from workers who seem foreign to them, which is the practice these rules were written to address in the first place. The advantage of a system is that its behaviour is uniform, logged and therefore measurable — you can compute the disparity and fix it centrally, which you cannot do with dispersed human judgment. The disadvantage is that a defect is applied to everyone at once. The right conclusion is not automation versus humans; it is that whichever you use needs the same instrumentation, because an unmeasured process is where the disparity lives regardless of who is running it.

Instrument the Second Ask

One event is worth more than a full model audit here: log every time the flow asks a worker for a document beyond the one they first presented, tagged with what they presented. That single counter converts an invisible legal question into a chart anyone can read.

Then remove the defaults, the optional-field nudges and the throughput target on the review queue. Those three changes require no model work and eliminate most of the structural exposure at this stage.