mini-jev

Last updated:

Open50–400ms$0/M input

Quadrant scores

See the full quadrant

Scored with the public quadrant rubric (maturity × capability; bubble = adoption). Revise as evidence lands.

  • Maturity2/10

    Preregistered teaching repo with demos — explicitly not a shipped decision product; lowest maturity on the map.

  • Capability3.2/10

    Measures letter-logit reads for closed choices on frozen Qwen3-4B; catalog types are choice+boolean only (score not studied).

  • Adoption7/100

    Useful citation in the method lane of S1Bench gaps; small audience beyond people studying select-over-generate.

Vendor claims

mini-jev is a teaching experiment, not a trained System One weight release: it shows how far a frozen Qwen3-4B gets by reading letter logits for closed-choice fields versus grammar-constrained JSON — by r-ms, not TypeSafe.

Catalog decisionTypes are choice and boolean only — the study did not measure Jev-style score. Repo: github.com/r-ms/mini-jev.

Limits (read before you ship)

  • Not a trained decision model — no RLCD, no pointer head, no released adapter claiming Jev parity.
  • Letter shares are normalized candidate scores, not calibrated probabilities.
  • Out-of-scope / abstention and dependent fields favour JSON generation in the author’s own results.
  • Do not put this on a procurement shortlist next to Jev or Decider.

Why it is in the catalog

Closes an S1Bench documentation gap: the “select-over-generate on a frozen LM” method, clearly labelled so the quadrant does not confuse it with trained peers.