MedDecider
Quadrant scores
See the full quadrantScored with the public quadrant rubric (maturity × capability; bubble = adoption). Revise as evidence lands.
- Maturity4.7/10
Medical decision adapters (PEFT) in four sizes (4B, 9B, 27B, 31B), CC BY-NC 4.0: non-commercial only. Detailed 27B card with quickstart and a bundled meddecider_infer script; no vLLM or /v1/systemone server documented. Technical report promised. No SLA.
- Capability6.4/10
Choice (2–10 options), yes/no and ordered scale, calibrated per question type. 27B author numbers vs Jev 1.13: unseen exams 64.4% vs 65.4%, robustness 88.3% vs 79.5%, planted-instruction compliance 3.0% vs 13.7%. No latency figures. Not on any board.
- Adoption2/100
Launch thread ~1k likes; under 15 downloads per checkpoint three days in. No integrations or clinical deployments found.
Vendor claims
- Passes every session of Poland’s final medical exam (LEK) 2008–2026: 87.1% over 4,722 questions; 89.2% on 286 new 2025–2026 questions vs 71.3% examinee average. The thread’s 92% figure does not appear on the card[Vendor claim — not independently verified]
Read this first
- Non-commercial license. CC BY-NC 4.0 on every size. Not a medical device.
- Author-run evaluations only. Two rows of the comparison table use test halves of sets whose training halves were in its training data (the card says so). UnverifiedClaim.
The family
| Checkpoint | Notes |
|---|---|
| MedDecider-27B | Qwen3.8-27B base (27.8B), 35,800 decisions / 7.5M tokens, one epoch, 85 min on one H200 |
| MedDecider-9B · 4B · 31B | The thread claims the 9B beats Perplexity’s 27B decider (UnverifiedClaim) |
Author numbers, 27B (UnverifiedClaim)
| MedDecider-27B | Jev 1.13 | Clef 27B | pplx-decider v1 | |
|---|---|---|---|---|
| Unseen medical exams (6) | 64.4% | 65.4% | 60.3% | 58.4% |
| Unseen clinical problem types (6) | 89.7% | 87.7% | 89.0% | 89.4% |
| Robustness (4) | 88.3% | 79.5% | 76.0% | 57.8% |
| Follows a planted instruction (lower is better) | 3.0% | 13.7% | 17.7% | 62.3% |
Score working (9 Oct 2026, scored on the 27B)
- Maturity = 6 × 0.30 + 7 × 0.25 + 3 × 0.25 + 2 × 0.20 = 1.80 + 1.75 + 0.75 + 0.40 = 4.70 → 4.7
- Capability = 9 × 0.30 + 6 × 0.25 + 4 × 0.25 + 6 × 0.20 = 2.70 + 1.50 + 1.00 + 1.20 = 6.40 → 6.4
- Adoption = 4 × 0.35 + 1 × 0.35 + 0 × 0.30 = 1.40 + 0.35 = 1.75 → 2
