Skip to content

Schemas and standalone verifiers for the lab's evidence

Counted in one directory of the lab's code at a named commit

Schema files
14
Of them, forbidding undeclared fields
14
Standalone verifier programs
11

A verifier does not import the program that wrote the file; paired verifiers share their checks.

The result

Several of the lab's evidence formats have a strict schema and a standalone verifier whose exit code is the verdict and which does not import the program that wrote the file; paired verifiers share their checks, so they are not independent implementations

What it does not claim

It counts files and reads schema settings; it does not run the verifiers here. Import independence is not implementation independence: both verifiers of a pair apply the same checks, and every escalated forgery the lab recorded got past both until someone attacked them. The lab's code is not public yet.

The limits, in the lab’s words:

NEG-F5-07 applies directly — 'two independent verifiers' is IMPORT-independent, not IMPLEMENTATION-independent: same checks, same report order, SAME OMISSIONS, and every forgery escalation survived in both until someone attacked.

Excerpts, word for word from the published file, where the full text can be read.

A result is only as good as the check that reads its evidence. The lab writes each kind of evidence file to a JSON schema that forbids fields it does not declare, and checks it with a small verifier program whose exit code is its verdict. A verifier does not import the program that produced the file, so a bug in the producer is not inherited by the import.

What it shows

In this count: the files in one directory of the lab's code at a named commit, counted by this site's own script.

The directory holds 14 schema files, and 14 of them forbid any field they do not declare and require at least one. It holds 11 verifier programs. The lab's own record had claimed a different number of each, and its limits state the counted ones; the count here agrees with them.

Why it matters, and to whom

For a buyer checking the lab's results, a verifier that does not share code with the producer can be read and run on its own, against a file the producer wrote. It narrows what has to be trusted. It does not remove it: the two verifiers of a pair were written from the same list of checks, so they miss the same things.

Why now

Results in this field are increasingly published as files a reader is asked to trust. A strict schema and a standalone checker make each such file checkable by its exit code, the way the verifier on this site's home page checks a file's fingerprint in the browser.

How it was checked

This site's script listed the directory at the lab commit, counted schema files and verifier files by name, and read each schema to see whether it forbids undeclared fields and requires at least one. The file names are committed by the hash of their sorted list.

How to reproduce

The count names the lab commit and directory. Anyone with access to the lab's code can list the same directory and recount. The claim and limits are copied word for word. Each file is listed with its hash in the site's receipt manifest.

The result, in the lab’s exact words

Read it with this condition: "does not import the producer" is the whole of the independence claimed. Two verifiers for the same file share their checks and their omissions, so a forgery that passes one passed both until it was found.

A reusable artifact-verification substrate where the exit code is the verdict and the verifier does not import the producer.

Quoted word for word from the lab’s published claim and limits.

Prior art

Evidence

Related results

All results from AxiomLimit · The AxiomLimit home page

How the numbers on this page are checked

Every number on this page links to the file it comes from. All published files.

  • Loadingshown only once its file has loaded in your browser
  • Not checkeda question we have not checked would say so, with no number
  • Checked, nothing founda search that found nothing would say so, with no number
  • No valuea file that holds no value for the question would say so
  • File missinga number whose file is missing or altered would be hidden
  • Unclear subjecttwo files that disagree about what a number describes would both be shown
  • Small samplea number from a small sample would carry its sample size
  • Conflicting filestwo files giving different values would both be shown
  • Not publishablea file we may not publish would be named by its fingerprint only
  • Out of datea measurement older than a week would carry its age
  • Does not applya question that does not apply to this page would say so
  • Run faileda measurement whose program failed would say so, with no number