Score

Rate the state against ordered levels. The answer has a score, a probability per level, the legend, and a confidence.

Request

State: "Since the update the export button does nothing; we can still export from the old menu, so we are not blocked."

{"type": "score", "instructions": "How severe is the reported issue?",
 "criteria": ["Cosmetic; no impact to functionality",
              "Broken or degraded feature, but a workaround exists",
              "Blocking issue; no workaround exists"]}

criteria is an ordered array of 2 to 10 level descriptions, from low to high.

Answer

{
 "type": "score",
 "score": 0.857,
 "confidence": 0.091,
 "probabilities": {
  "0": 0.309,
  "1": 0.526,
  "2": 0.166
 },
 "legend": {
  "0": "Cosmetic; no impact to functionality",
  "1": "Broken or degraded feature, but a workaround exists",
  "2": "Blocking issue; no workaround exists"
 }
}

score is the probability-weighted level: 0 × 0.309 + 1 × 0.526 + 2 × 0.166 = 0.857, for the state "Since the update the export button does nothing; we can still export from the old menu, so we are not blocked." It can fall between levels.

Guidance

  • Describe levels as situations ("a workaround exists"), not degrees ("moderately severe").
  • One dimension per question. Combine dimensions in code, normalised to 0 to 1 and weighted.
  • Use Choice for unordered categories and Noul for yes/no.