Skip to main content
SignedAI jury (open source)

Ask several independent models, and keep a signed verdict you can re-check

SignedAI is the jury runner in Delentia's open-source repository. You use it with delentia jury run and re-check a verdict with delentia jury verify. It is not a hosted API and has no price.

How it works

  1. 1Every member of the jury gets the same question about the same proposal, independently. They do not see each other's answers.
  2. 2Each reply is read as agree, disagree or abstain. A reply that cannot be read, a timeout or an error counts as abstain, never as agree.
  3. 3The tier sets how many agreeing votes are required and what share of the jury they must be. Abstentions never help a proposal pass.
  4. 4The verdict is written as a canonical record with a SHA-256 digest and can be signed with an Ed25519 key. Anyone can re-check it with delentia jury verify.

Rules built into the code

  • A jury of one model is not a jury. If fewer than the required number of different models answered, consensus is not reached.
  • In the strictest tier the chairman can veto, but cannot force a pass over a disagreeing jury.
  • Keys are never stored in the jury file. It names an environment variable instead.

Tested

  • The vote rules above are covered by tests that use scripted voters.
  • A harness runs four separate HTTP servers as members and checks the signed verdict.

Not done, not claimed

  • No real vote across several vendors' models has been run.
  • Nothing here shows that a jury is more accurate than one model, or reduces hallucination. No such figure is claimed.
  • There is no hosted SignedAI API, no per-review price and no fixed roster of models.