Invented names · Use invented names variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
Read the full context
Nelora went back to the garden. Zorvik went back to the bedroom. Nelora went back to the kitchen. Tavren travelled to the office. Nelora moved to the bathroom. Zorvik travelled to the office. Nelora got the football. Tavren journeyed to the hallway. Nelora went to the hallway. Tavren travelled to the office. Nelora travelled to the bedroom. Tavren moved to the bedroom. Zorvik journeyed to the garden. Nelora dropped the football. Nelora journeyed to the garden. Vaelis travelled to the hallway. Tavren travelled to the kitchen. Vaelis moved to the bedroom. Nelora went to the bathroom. Zorvik moved to the bedroom. Vaelis travelled to the hallway. Tavren moved to the hallway. Tavren got the milk. Nelora travelled to the hallway. Nelora journeyed to the kitchen. Zorvik went to the office. Tavren went to the kitchen. Tavren put down the milk. Zorvik moved to the bedroom. Vaelis moved to the kitchen. Nelora moved to the hallway. Vaelis went to the bathroom. Tavren travelled to the garden. Nelora went back to the office. Nelora picked up the apple. Zorvik grabbed the football. Zorvik left the football there. Nelora dropped the apple there. Vaelis went back to the office. Zorvik went to the kitchen. Vaelis took the apple. Vaelis travelled to the hallway. Zorvik grabbed the milk there. Nelora went back to the bedroom. Tavren journeyed to the office. Vaelis discarded the apple. Zorvik journeyed to the garden. Tavren moved to the hallway. Vaelis picked up the apple there. Vaelis dropped the apple. Vaelis travelled to the office. Tavren picked up the apple. Nelora journeyed to the bathroom. Nelora journeyed to the kitchen. Nelora travelled to the bedroom. Nelora took the football. Nelora put down the football. Vaelis went back to the garden. Zorvik dropped the milk. Vaelis took the milk. Zorvik moved to the kitchen. Vaelis journeyed to the bathroom. Vaelis dropped the milk there. Vaelis went to the hallway. Tavren went to the garden. Zorvik went to the bedroom. Tavren left the apple. Zorvik took the football. Vaelis went back to the office. Tavren journeyed to the hallway. Vaelis went back to the garden. Vaelis went to the office. Vaelis went to the garden. Nelora went back to the kitchen. Vaelis journeyed to the bathroom. Nelora went to the garden. Vaelis took the milk there. Nelora journeyed to the hallway. Vaelis went to the garden. Vaelis discarded the milk there. Zorvik discarded the football. Zorvik grabbed the football. Zorvik dropped the football. Vaelis moved to the hallway. Zorvik moved to the garden. Zorvik took the apple. Zorvik discarded the apple. Zorvik got the apple. Nelora went to the kitchen. Zorvik journeyed to the kitchen. Zorvik went to the garden. Vaelis journeyed to the bedroom.
Question
Where was the apple before the garden?
Answer choices
- A. bathroom
- B. garden
- C. bedroom
- D. kitchen
- E. hallway
- F. office
Reference answer: D.
Exact evaluated input as JSON
{
"state": "Nelora went back to the garden.\nZorvik went back to the bedroom.\nNelora went back to the kitchen.\nTavren travelled to the office.\nNelora moved to the bathroom.\nZorvik travelled to the office.\nNelora got the football.\nTavren journeyed to the hallway.\nNelora went to the hallway.\nTavren travelled to the office.\nNelora travelled to the bedroom.\nTavren moved to the bedroom.\nZorvik journeyed to the garden.\nNelora dropped the football.\nNelora journeyed to the garden.\nVaelis travelled to the hallway.\nTavren travelled to the kitchen.\nVaelis moved to the bedroom.\nNelora went to the bathroom.\nZorvik moved to the bedroom.\nVaelis travelled to the hallway.\nTavren moved to the hallway.\nTavren got the milk.\nNelora travelled to the hallway.\nNelora journeyed to the kitchen.\nZorvik went to the office.\nTavren went to the kitchen.\nTavren put down the milk.\nZorvik moved to the bedroom.\nVaelis moved to the kitchen.\nNelora moved to the hallway.\nVaelis went to the bathroom.\nTavren travelled to the garden.\nNelora went back to the office.\nNelora picked up the apple.\nZorvik grabbed the football.\nZorvik left the football there.\nNelora dropped the apple there.\nVaelis went back to the office.\nZorvik went to the kitchen.\nVaelis took the apple.\nVaelis travelled to the hallway.\nZorvik grabbed the milk there.\nNelora went back to the bedroom.\nTavren journeyed to the office.\nVaelis discarded the apple.\nZorvik journeyed to the garden.\nTavren moved to the hallway.\nVaelis picked up the apple there.\nVaelis dropped the apple.\nVaelis travelled to the office.\nTavren picked up the apple.\nNelora journeyed to the bathroom.\nNelora journeyed to the kitchen.\nNelora travelled to the bedroom.\nNelora took the football.\nNelora put down the football.\nVaelis went back to the garden.\nZorvik dropped the milk.\nVaelis took the milk.\nZorvik moved to the kitchen.\nVaelis journeyed to the bathroom.\nVaelis dropped the milk there.\nVaelis went to the hallway.\nTavren went to the garden.\nZorvik went to the bedroom.\nTavren left the apple.\nZorvik took the football.\nVaelis went back to the office.\nTavren journeyed to the hallway.\nVaelis went back to the garden.\nVaelis went to the office.\nVaelis went to the garden.\nNelora went back to the kitchen.\nVaelis journeyed to the bathroom.\nNelora went to the garden.\nVaelis took the milk there.\nNelora journeyed to the hallway.\nVaelis went to the garden.\nVaelis discarded the milk there.\nZorvik discarded the football.\nZorvik grabbed the football.\nZorvik dropped the football.\nVaelis moved to the hallway.\nZorvik moved to the garden.\nZorvik took the apple.\nZorvik discarded the apple.\nZorvik got the apple.\nNelora went to the kitchen.\nZorvik journeyed to the kitchen.\nZorvik went to the garden.\nVaelis journeyed to the bedroom.",
"question": "Where was the apple before the garden? ",
"choices": {
"A": "bathroom",
"B": "garden",
"C": "bedroom",
"D": "kitchen",
"E": "hallway",
"F": "office"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | D — kitchen |
D — kitchen |
Same answer |
| Decider v1.1 | D — kitchen |
D — kitchen |
Same answer |
| Jev | E — hallway |
E — hallway |
Same answer |
| Microsoft Decision-1 | D — kitchen |
D — kitchen |
Same answer |
| Clef | D — kitchen |
D — kitchen |
Same answer |
| Luna Decisions | E — hallway |
F — office |
Different answer |
| Clef Flash | E — hallway |
E — hallway |
Same answer |
| Strands Decider | B — garden |
B — garden |
Same answer |
| GLiNER2.5 Decide | B — garden |
B — garden |
Same answer |
| Laya | F — office |
F — office |
Same answer |
| CalDec v1 | B — garden |
F — office |
Different answer |
Identifiers and recorded conditions
Variant ID: babi/2755256213552c1db112/unfamiliar_names/invented
Input fingerprint: ec92d306635a2cae63759ae4fd9232d635595d7aad311d7770e8d857e56bd0b7
| Change | Recorded version |
|---|---|
| Invented names | Use invented names |
Source attribution and dataset terms are linked from the original question.