AI That Checks AI

Cross-validation from composable providers

The Frame

When one model answers, you can't tell confidence from confabulation.

A single model states everything with the same certainty — including the things it made up. What if the check were another, independent model? That only becomes possible if AI providers are interchangeable.

In Amplifier, they are.

Proof · Already Side by Side

One GitHub Copilot module exposes 14 models across three vendor families.

The microsoft/amplifier-module-provider-github-copilot module enumerates 14 models through a single interface — Claude, GPT, and Gemini reachable at once. Not hypothetical: they are already there.

Multiple vendors, one seam. So how does that hold together?

Claude4

GPT9

Gemini1

Total models14

Mechanism · The Contract

Every provider implements the same 5-method Provider Protocol.

A small uniform contract — plus one async mount() seam that can return None for graceful degradation — is what makes each AI vendor a genuinely swappable module.

Uniform in, uniform out. Now watch two of them run together.

name — the provider's identifier
get_info → ProviderInfo
list_models — enumerate models
complete → ChatResponse
parse_tool_calls — read tool calls

Setup · Two Real Modules

The Anthropic module and the Copilot module mount into one shared registry.

The standalone Anthropic provider (extracted from the monorepo in 2025) and the Copilot provider both mount into a shared named providers registry — so they coexist in a single session.

Two providers, one bundle. Now: how do you point a question at a specific one?

# both mount into name="providers"
mount("providers", provider,
      name="anthropic")

mount("providers", provider,
      name="github-copilot")

Mechanism · Routing

tool-delegate routes each sub-session to a chosen provider and model.

The tool-delegate module accepts an ordered provider_preferences list — provider plus model, with glob pattern support — so each spawned sub-session can be pinned to a specific model.

Interchangeable providers, plus per-delegation routing. Two primitives — but is the capability itself shipped?

# route each sub-session
provider_preferences:
  - provider: github-copilot
    model: claude-sonnet-4
  - provider: github-copilot
    model: gpt-*

The Tension

Grep the source for "swarm" or "cross-validate" and you find nothing.

No swarm, consensus, quorum, or cross-validate exists in the provider, core, or foundation source. Cross-validation is an emergent capability — not a named feature anyone shipped.

So if no one built it — where does it come from?

# searched provider/core/foundation
grep -rniE 'swarm|consensus|
  quorum|cross-validate' .

# → no matches

The Payoff

Ask Claude, GPT, and Gemini the same question in parallel — and treat their agreement as a confidence signal.

Stack interchangeable providers with per-delegation routing and cross-validating AI with AI falls out for free — an emergent capability no one had to ship.

The Takeaway

Compose the right primitives and capabilities emerge you never had to build.

A uniform provider contract and per-delegation routing were built separately. Together they yield cross-validation for free. Modular architecture is the multiplier.

Sources

Research Methodology

Provider layer: SHIPPED · Cross-validation: EMERGENT, not a named feature

Data as of: Local clones under /home/ramparte/dev/ANext (microsoft/* and ramparte/*); GitHub remotes checked 2026-07-17 / 2026-07-20.

Correct source repo: microsoft/amplifier-module-provider-github-copilot (the suggested marklicata repo is a fork of a deprecated GitHub-Models-API module — isFork=true, parent robotdad/deprecated-...).

Commands run:

git config --get remote.origin.url
gh repo view marklicata/... --json isFork,parent,pushedAt
grep -cE '^\s*"(claude|gpt|gemini)' provider.py (14 models)

More commands:

grep -rn 'mount("providers"' ... (anthropic + github-copilot)
sed -n '31,45p' PROVIDER_SPECIFICATION.md (5-method Protocol)
grep -n 'provider_preferences' tool-delegate/__init__.py
grep -rniE 'swarm|consensus|quorum|cross-validate' . (no matches)
git log --reverse --date=short / shortlog -sne --all

Contributors: Marc Goodner (initial Copilot module commit, 2026-02-10), Brian Krabach (top committer; extracted Anthropic module 2025-10-08), Sam Schillace (recent fixes), Mowri Mohan / HDMowri, Yu Zhang.

Gaps: Local Copilot clone HEAD (13 commits, to 2026-02-13) trails the remote (pushedAt 2026-07-17); contributor counts require --all (remote branches). "Four providers side by side" is narrative shorthand: only Anthropic + Copilot modules exist locally — OpenAI/Gemini access is through the Copilot module.