RaindropA practical guide to choosing decision modelsGitHub ↗

Similar distractors · Add more similar but irrelevant items variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

A refrain ends on the tonic. What would have happened if the refrain had ended on the dominant?

A melodic phrase uses detached articulation. What would have happened if the phrase had used sustained articulation?

A musical variation repeats an interval. What would have happened if the variation had omitted that interval?

Question

A woman swallows potassium cyanide. What would have happened if the woman had watched potassium cyanide?

Answer choices

  • A. Nothing special would have happened.
  • B. She would have died.
  • C. She would have vomited.
  • D. That is not possible.

Reference answer: A.

Exact evaluated input as JSON
{
  "state": "A refrain ends on the tonic. What would have happened if the refrain had ended on the dominant?\n\nA melodic phrase uses detached articulation. What would have happened if the phrase had used sustained articulation?\n\nA musical variation repeats an interval. What would have happened if the variation had omitted that interval?",
  "question": "A woman swallows potassium cyanide. What would have happened if the woman had watched potassium cyanide?",
  "choices": {
    "A": "Nothing special would have happened.",
    "B": "She would have died.",
    "C": "She would have vomited.",
    "D": "That is not possible."
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 A — Nothing special would have happened. A — Nothing special would have happened. Same answer
Decider v1.1 A — Nothing special would have happened. A — Nothing special would have happened. Same answer
Jev A — Nothing special would have happened. A — Nothing special would have happened. Same answer
Microsoft Decision-1 A — Nothing special would have happened. A — Nothing special would have happened. Same answer
Clef A — Nothing special would have happened. A — Nothing special would have happened. Same answer
Luna Decisions A — Nothing special would have happened. A — Nothing special would have happened. Same answer
Clef Flash A — Nothing special would have happened. A — Nothing special would have happened. Same answer
Strands Decider B — She would have died. D — That is not possible. Different answer
GLiNER2.5 Decide B — She would have died. A — Nothing special would have happened. Different answer
Laya B — She would have died. B — She would have died. Same answer
CalDec v1 B — She would have died. B — She would have died. Same answer
Identifiers and recorded conditions

Variant ID: crass/58e45d40ffc5e28b025c/similar_distractors/high/clean-source_first_crass_contexts_full_0199

Input fingerprint: 78ad93e423a9956154828ebb7f5726b600342da02ec4510d3f39eb67007896f3

Change Recorded version
Similar distractors Add more similar but irrelevant items

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.