Invented names · Use invented names variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
Nelora got the milk. Zorvik journeyed to the office. Nelora discarded the milk. Nelora took the milk. Zorvik went to the bathroom. Nelora left the milk. Tavren went to the garden. Vaelis moved to the garden. Vaelis went to the bathroom. Tavren went back to the bedroom. Vaelis got the football. Vaelis discarded the football. Nelora got the milk there. Zorvik moved to the office. Tavren went to the hallway. Vaelis journeyed to the garden. Nelora left the milk. Tavren went back to the bedroom. Tavren took the milk. Tavren left the milk. Nelora moved to the kitchen. Nelora went back to the bathroom. Zorvik journeyed to the bedroom. Tavren went back to the office. Nelora took the football. Nelora discarded the football. Nelora grabbed the football. Zorvik journeyed to the office. Nelora put down the football. Nelora took the football. Nelora journeyed to the hallway. Nelora left the football. Nelora picked up the apple. Vaelis moved to the hallway. Vaelis took the football. Nelora went back to the garden. Nelora left the apple. Vaelis went to the office. Tavren journeyed to the garden. Zorvik went back to the bathroom. Nelora went back to the office. Tavren grabbed the apple. Nelora went back to the bathroom. Zorvik travelled to the kitchen. Nelora journeyed to the kitchen. Nelora moved to the bathroom. Vaelis went to the kitchen. Vaelis left the football.
Question
Where was the football before the kitchen?
Answer choices
- A. bathroom
- B. hallway
- C. kitchen
- D. bedroom
- E. office
- F. garden
Reference answer: E.
Exact evaluated input as JSON
{
"state": "Nelora got the milk.\nZorvik journeyed to the office.\nNelora discarded the milk.\nNelora took the milk.\nZorvik went to the bathroom.\nNelora left the milk.\nTavren went to the garden.\nVaelis moved to the garden.\nVaelis went to the bathroom.\nTavren went back to the bedroom.\nVaelis got the football.\nVaelis discarded the football.\nNelora got the milk there.\nZorvik moved to the office.\nTavren went to the hallway.\nVaelis journeyed to the garden.\nNelora left the milk.\nTavren went back to the bedroom.\nTavren took the milk.\nTavren left the milk.\nNelora moved to the kitchen.\nNelora went back to the bathroom.\nZorvik journeyed to the bedroom.\nTavren went back to the office.\nNelora took the football.\nNelora discarded the football.\nNelora grabbed the football.\nZorvik journeyed to the office.\nNelora put down the football.\nNelora took the football.\nNelora journeyed to the hallway.\nNelora left the football.\nNelora picked up the apple.\nVaelis moved to the hallway.\nVaelis took the football.\nNelora went back to the garden.\nNelora left the apple.\nVaelis went to the office.\nTavren journeyed to the garden.\nZorvik went back to the bathroom.\nNelora went back to the office.\nTavren grabbed the apple.\nNelora went back to the bathroom.\nZorvik travelled to the kitchen.\nNelora journeyed to the kitchen.\nNelora moved to the bathroom.\nVaelis went to the kitchen.\nVaelis left the football.",
"question": "Where was the football before the kitchen? ",
"choices": {
"A": "bathroom",
"B": "hallway",
"C": "kitchen",
"D": "bedroom",
"E": "office",
"F": "garden"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | E — office |
E — office |
Same answer |
| Decider v1.1 | E — office |
E — office |
Same answer |
| Jev | E — office |
E — office |
Same answer |
| Microsoft Decision-1 | E — office |
E — office |
Same answer |
| Clef | E — office |
E — office |
Same answer |
| Luna Decisions | B — hallway |
B — hallway |
Same answer |
| Clef Flash | B — hallway |
B — hallway |
Same answer |
| Strands Decider | B — hallway |
B — hallway |
Same answer |
| GLiNER2.5 Decide | F — garden |
F — garden |
Same answer |
| Laya | A — bathroom |
A — bathroom |
Same answer |
| CalDec v1 | A — bathroom |
C — kitchen |
Different answer |
Identifiers and recorded conditions
Variant ID: babi/93021258c6ea2e72208f/unfamiliar_names/invented
Input fingerprint: b6c55d889a02aede42005116dda69613002df7722a1857a38402ec084dbda555
| Change | Recorded version |
|---|---|
| Invented names | Use invented names |
Source attribution and dataset terms are linked from the original question.