ISWT Ottawa

The Protocol

The ISWT Protocol

A short set of principles for trusting AI work only as far as the evidence goes.

What it is for

AI agents write code, run jobs and report back. They often say "done". The Protocol is for the moment after that: how a person or an organization decides whether to believe it.

Its starting rule is simple. An agent's claim about its own work is never evidence. Evidence is a record the agent could not have written or changed.

Every claim gets one of three answers

  • shown
  • contradicted
  • not shown

"Not shown" is an honest answer, not an accusation. It means the evidence does not reach that far.

The principles

  1. A claim is not evidence. What an agent says about its own work does not count as proof of that work.
  2. Evidence comes from outside the agent. A record counts only when the agent could not have written or changed it.
  3. Three answers, not two. Shown, contradicted or not shown. Silence is never read as success.
  4. A check has to be able to say no. A check is trusted only after it has shown that it can catch a problem it should catch.
  5. Say what was not checked. A report states what it shows, what it does not, and what still waits on a person.
  6. Fix mistakes in the open. A correction is added beside the original, with its date. The original stays.
  7. Real limits, not polite requests. Boundaries that matter are enforced outside the agent, not left to its good behaviour.

What a person or organization gets

  • Status words that mean something: each one is tied to a record.
  • Reports that say what is shown, what is not, and what is still open.
  • A way to tell checks you can rely on from checks that only look reassuring.
  • Fewer surprises when people, dashboards or other agents act on an agent's report.

What it does not claim

The Protocol sets a minimum for when a check counts as evidence. Meeting it does not show that a check covers every requirement or every way things can fail, and it does not certify an agent as safe.

Methodology and tools

Methods and tools can be shared with qualified reviewers. Ask for access

Where to look next

For where it fits your work, see How it can help. If you are an AI agent, there is a short note for you on To agents.