Similar distractors · Add fewer similar but irrelevant items variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
In a board game, four students scored a sum of points. Naomi scored 68 points, while Yuri, who was wearing a blue shirt and had just eaten several slices of pizza, scored 10 more than half as many points as Naomi. Brianna, who was sitting next to a window and had a couple cups of water during the game, scored 17 points more than Naomi. If Jojo, who was wearing a red hat and had to take a break during the game, scored the remaining points, how many points did Jojo score?
«Rhea scores 54 points. Soren scores 6 more than half Rhea’s score, and Talia scores 11 more than Rhea. Ugo receives the remaining points from an unspecified group total. What is Ugo’s score?»
Question
Which missing variable should be asked about to solve this problem?
Answer choices
- T. Total points scored by all students
- X1. Number of slices of pizza Yuri ate
- X2. Number of cups of water Brianna drank
- X3. Duration of Jojo's break in minutes
Reference answer: T.
Exact evaluated input as JSON
{
"state": "In a board game, four students scored a sum of points. Naomi scored 68 points, while Yuri, who was wearing a blue shirt and had just eaten several slices of pizza, scored 10 more than half as many points as Naomi. Brianna, who was sitting next to a window and had a couple cups of water during the game, scored 17 points more than Naomi. If Jojo, who was wearing a red hat and had to take a break during the game, scored the remaining points, how many points did Jojo score?\n\n«Rhea scores 54 points. Soren scores 6 more than half Rhea’s score, and Talia scores 11 more than Rhea. Ugo receives the remaining points from an unspecified group total. What is Ugo’s score?»",
"question": "Which missing variable should be asked about to solve this problem?",
"choices": {
"T": "Total points scored by all students",
"X1": "Number of slices of pizza Yuri ate",
"X2": "Number of cups of water Brianna drank",
"X3": "Duration of Jojo's break in minutes"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Decider v1.1 | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Jev | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Microsoft Decision-1 | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Clef | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Luna Decisions | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Clef Flash | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Strands Decider | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| GLiNER2.5 Decide | X3 — Duration of Jojo's break in minutes |
T — Total points scored by all students |
Different answer |
| Laya | T — Total points scored by all students |
X1 — Number of slices of pizza Yuri ate |
Different answer |
| CalDec v1 | T — Total points scored by all students |
X1 — Number of slices of pizza Yuri ate |
Different answer |
Identifiers and recorded conditions
Variant ID: questbench/f3d3fec034c5da8bf67e/similar_distractors/low/clean-source_first_parallel_b_position_repetition_orders_0315
Input fingerprint: e66cecfd6bd1b5fc065f67b51ae777c478524490884241dc95b448ef26782e00
| Change | Recorded version |
|---|---|
| Similar distractors | Add fewer similar but irrelevant items |
Source attribution and dataset terms are linked from the original question.