Invented names · Use invented names variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
Read the full context
Nelora moved to the office. Vaelis journeyed to the kitchen. Nelora went back to the bedroom. Tavren moved to the office. Nelora took the milk. Vaelis went to the hallway. Nelora picked up the football. Tavren went to the garden. Tavren moved to the bathroom. Vaelis journeyed to the bedroom. Nelora travelled to the hallway. Zorvik went to the bathroom. Nelora discarded the milk there. Nelora put down the football. Nelora travelled to the kitchen. Vaelis journeyed to the garden. Tavren went back to the hallway. Tavren grabbed the football. Vaelis travelled to the hallway. Tavren left the football. Vaelis went back to the garden. Nelora went back to the bedroom. Vaelis went back to the kitchen. Vaelis travelled to the hallway. Nelora went back to the office. Tavren travelled to the garden. Nelora journeyed to the bathroom. Vaelis grabbed the milk. Vaelis discarded the milk. Zorvik moved to the hallway. Vaelis went back to the office. Zorvik took the football. Zorvik dropped the football. Tavren journeyed to the kitchen. Zorvik travelled to the garden. Tavren went back to the bathroom. Vaelis travelled to the bedroom. Tavren moved to the garden. Tavren travelled to the bathroom. Tavren went back to the office. Tavren went to the bathroom. Tavren went to the hallway. Tavren grabbed the football there. Nelora journeyed to the garden. Vaelis travelled to the garden. Nelora went back to the bedroom. Nelora travelled to the hallway. Zorvik journeyed to the hallway. Tavren grabbed the milk there. Vaelis moved to the hallway. Vaelis travelled to the garden. Zorvik grabbed the apple. Zorvik discarded the apple. Zorvik travelled to the office. Zorvik went back to the hallway. Zorvik got the apple. Vaelis journeyed to the hallway. Nelora went back to the office. Nelora travelled to the kitchen. Zorvik dropped the apple. Zorvik took the apple. Zorvik moved to the kitchen. Tavren discarded the milk. Tavren moved to the garden. Zorvik left the apple there. Tavren travelled to the kitchen. Vaelis travelled to the bathroom. Zorvik got the apple. Tavren left the football. Zorvik got the football. Vaelis went back to the bedroom. Zorvik moved to the hallway. Zorvik discarded the apple. Zorvik discarded the football. Vaelis went to the hallway. Zorvik travelled to the office. Vaelis took the apple. Nelora travelled to the hallway. Nelora picked up the football. Nelora moved to the bathroom. Tavren moved to the hallway. Nelora went back to the garden. Vaelis got the milk. Zorvik moved to the bedroom. Tavren travelled to the kitchen. Nelora discarded the football. Nelora moved to the hallway. Zorvik travelled to the hallway. Tavren went back to the bedroom. Vaelis dropped the milk. Vaelis got the milk. Nelora moved to the bathroom. Vaelis left the apple there. Vaelis discarded the milk. Vaelis travelled to the office. Vaelis travelled to the kitchen. Tavren went back to the bathroom. Vaelis moved to the hallway. Zorvik grabbed the milk. Tavren journeyed to the kitchen. Vaelis travelled to the office. Zorvik took the apple. Zorvik travelled to the kitchen. Zorvik travelled to the office.
Question
Where was the apple before the office?
Answer choices
- A. kitchen
- B. bathroom
- C. bedroom
- D. hallway
- E. office
- F. garden
Reference answer: A.
Exact evaluated input as JSON
{
"state": "Nelora moved to the office.\nVaelis journeyed to the kitchen.\nNelora went back to the bedroom.\nTavren moved to the office.\nNelora took the milk.\nVaelis went to the hallway.\nNelora picked up the football.\nTavren went to the garden.\nTavren moved to the bathroom.\nVaelis journeyed to the bedroom.\nNelora travelled to the hallway.\nZorvik went to the bathroom.\nNelora discarded the milk there.\nNelora put down the football.\nNelora travelled to the kitchen.\nVaelis journeyed to the garden.\nTavren went back to the hallway.\nTavren grabbed the football.\nVaelis travelled to the hallway.\nTavren left the football.\nVaelis went back to the garden.\nNelora went back to the bedroom.\nVaelis went back to the kitchen.\nVaelis travelled to the hallway.\nNelora went back to the office.\nTavren travelled to the garden.\nNelora journeyed to the bathroom.\nVaelis grabbed the milk.\nVaelis discarded the milk.\nZorvik moved to the hallway.\nVaelis went back to the office.\nZorvik took the football.\nZorvik dropped the football.\nTavren journeyed to the kitchen.\nZorvik travelled to the garden.\nTavren went back to the bathroom.\nVaelis travelled to the bedroom.\nTavren moved to the garden.\nTavren travelled to the bathroom.\nTavren went back to the office.\nTavren went to the bathroom.\nTavren went to the hallway.\nTavren grabbed the football there.\nNelora journeyed to the garden.\nVaelis travelled to the garden.\nNelora went back to the bedroom.\nNelora travelled to the hallway.\nZorvik journeyed to the hallway.\nTavren grabbed the milk there.\nVaelis moved to the hallway.\nVaelis travelled to the garden.\nZorvik grabbed the apple.\nZorvik discarded the apple.\nZorvik travelled to the office.\nZorvik went back to the hallway.\nZorvik got the apple.\nVaelis journeyed to the hallway.\nNelora went back to the office.\nNelora travelled to the kitchen.\nZorvik dropped the apple.\nZorvik took the apple.\nZorvik moved to the kitchen.\nTavren discarded the milk.\nTavren moved to the garden.\nZorvik left the apple there.\nTavren travelled to the kitchen.\nVaelis travelled to the bathroom.\nZorvik got the apple.\nTavren left the football.\nZorvik got the football.\nVaelis went back to the bedroom.\nZorvik moved to the hallway.\nZorvik discarded the apple.\nZorvik discarded the football.\nVaelis went to the hallway.\nZorvik travelled to the office.\nVaelis took the apple.\nNelora travelled to the hallway.\nNelora picked up the football.\nNelora moved to the bathroom.\nTavren moved to the hallway.\nNelora went back to the garden.\nVaelis got the milk.\nZorvik moved to the bedroom.\nTavren travelled to the kitchen.\nNelora discarded the football.\nNelora moved to the hallway.\nZorvik travelled to the hallway.\nTavren went back to the bedroom.\nVaelis dropped the milk.\nVaelis got the milk.\nNelora moved to the bathroom.\nVaelis left the apple there.\nVaelis discarded the milk.\nVaelis travelled to the office.\nVaelis travelled to the kitchen.\nTavren went back to the bathroom.\nVaelis moved to the hallway.\nZorvik grabbed the milk.\nTavren journeyed to the kitchen.\nVaelis travelled to the office.\nZorvik took the apple.\nZorvik travelled to the kitchen.\nZorvik travelled to the office.",
"question": "Where was the apple before the office? ",
"choices": {
"A": "kitchen",
"B": "bathroom",
"C": "bedroom",
"D": "hallway",
"E": "office",
"F": "garden"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | A — kitchen |
A — kitchen |
Same answer |
| Decider v1.1 | A — kitchen |
A — kitchen |
Same answer |
| Jev | A — kitchen |
A — kitchen |
Same answer |
| Microsoft Decision-1 | A — kitchen |
A — kitchen |
Same answer |
| Clef | A — kitchen |
A — kitchen |
Same answer |
| Luna Decisions | D — hallway |
D — hallway |
Same answer |
| Clef Flash | A — kitchen |
D — hallway |
Different answer |
| Strands Decider | A — kitchen |
A — kitchen |
Same answer |
| GLiNER2.5 Decide | E — office |
F — garden |
Different answer |
| Laya | A — kitchen |
A — kitchen |
Same answer |
| CalDec v1 | E — office |
E — office |
Same answer |
Identifiers and recorded conditions
Variant ID: babi/94b56fad9ffb1fb6bffd/unfamiliar_names/invented
Input fingerprint: f8052e9ff8838b5d9c3d4e827be6c483627cb9d10c0d795bfd983668113def86
| Change | Recorded version |
|---|---|
| Invented names | Use invented names |
Source attribution and dataset terms are linked from the original question.