Invented names · Use invented names variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context, answer choices or their order.
How the edits were constructed
Context
In a board game, four students scored a sum of points. Sorveth scored 68 points, while Velnar, who was wearing a blue shirt and had just eaten several slices of pizza, scored 10 more than half as many points as Sorveth. Tovrin, who was sitting next to a window and had a couple cups of water during the game, scored 17 points more than Sorveth. If Neraval, who was wearing a red hat and had to take a break during the game, scored the remaining points, how many points did Neraval score?
Question
Which missing variable should be asked about to solve this problem?
Answer choices
- T. Total points scored by all students
- X1. Number of slices of pizza Velnar ate
- X2. Number of cups of water Tovrin drank
- X3. Duration of Neraval's break in minutes
Reference answer: T.
Exact evaluated input as JSON
{
"state": "In a board game, four students scored a sum of points. Sorveth scored 68 points, while Velnar, who was wearing a blue shirt and had just eaten several slices of pizza, scored 10 more than half as many points as Sorveth. Tovrin, who was sitting next to a window and had a couple cups of water during the game, scored 17 points more than Sorveth. If Neraval, who was wearing a red hat and had to take a break during the game, scored the remaining points, how many points did Neraval score?",
"question": "Which missing variable should be asked about to solve this problem?",
"choices": {
"T": "Total points scored by all students",
"X1": "Number of slices of pizza Velnar ate",
"X2": "Number of cups of water Tovrin drank",
"X3": "Duration of Neraval's break in minutes"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Decider v1.1 | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Jev | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Microsoft Decision-1 | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Clef | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Luna Decisions | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Clef Flash | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| Strands Decider | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| GLiNER2.5 Decide | X3 — Duration of Jojo's break in minutes |
T — Total points scored by all students |
Different answer |
| Laya | T — Total points scored by all students |
T — Total points scored by all students |
Same answer |
| CalDec v1 | T — Total points scored by all students |
X1 — Number of slices of pizza Velnar ate |
Different answer |
Identifiers and recorded conditions
Variant ID: questbench/f3d3fec034c5da8bf67e/unfamiliar_names/invented
Input fingerprint: e8f269cdd2f03c44a0b0f8b4d5be1a90dd5c6989c980efd43f2e2f1d564305ee
| Change | Recorded version |
|---|---|
| Invented names | Use invented names |
Source attribution and dataset terms are linked from the original question.