Invented names · Use invented names variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
Read the full context
Tavren went to the hallway. Tavren went to the kitchen. Nelora went back to the hallway. Zorvik picked up the apple. Zorvik went to the garden. Tavren journeyed to the hallway. Zorvik journeyed to the hallway. Nelora moved to the office. Tavren went back to the kitchen. Zorvik discarded the apple there. Zorvik picked up the apple. Zorvik left the apple there. Nelora went to the bedroom. Nelora moved to the kitchen. Zorvik grabbed the apple. Tavren went to the garden. Nelora moved to the office. Tavren went to the bedroom. Nelora went back to the bedroom. Tavren journeyed to the hallway. Tavren went to the bedroom. Zorvik put down the apple. Zorvik moved to the bedroom. Nelora moved to the bathroom. Zorvik moved to the bathroom. Nelora travelled to the garden. Nelora journeyed to the kitchen. Vaelis journeyed to the hallway. Vaelis travelled to the office. Nelora travelled to the garden. Zorvik got the milk. Zorvik went back to the garden. Nelora went back to the bedroom. Zorvik went back to the kitchen. Nelora travelled to the garden. Tavren moved to the kitchen. Vaelis journeyed to the bathroom. Vaelis grabbed the football. Zorvik went back to the office. Zorvik moved to the kitchen. Zorvik travelled to the office. Vaelis went back to the hallway. Zorvik discarded the milk. Zorvik took the milk. Vaelis dropped the football. Tavren journeyed to the garden. Zorvik discarded the milk. Zorvik got the milk. Zorvik left the milk. Vaelis grabbed the football. Tavren travelled to the bathroom. Vaelis discarded the football. Zorvik went to the bedroom. Zorvik moved to the kitchen. Vaelis picked up the football there. Vaelis dropped the football. Tavren travelled to the bedroom. Vaelis moved to the office. Vaelis went back to the bathroom. Nelora went to the bathroom. Tavren moved to the garden. Zorvik went to the bedroom. Vaelis went back to the hallway. Vaelis took the apple. Vaelis grabbed the football. Vaelis dropped the apple. Tavren travelled to the bathroom. Nelora went back to the office. Vaelis dropped the football there. Tavren travelled to the office. Zorvik travelled to the kitchen. Vaelis got the apple. Tavren picked up the milk. Vaelis grabbed the football there. Vaelis put down the football. Vaelis moved to the garden. Zorvik moved to the office. Nelora moved to the bedroom. Tavren dropped the milk. Zorvik grabbed the milk. Tavren moved to the bedroom. Nelora travelled to the office. Vaelis went back to the bathroom. Zorvik went back to the hallway. Vaelis went to the office. Nelora journeyed to the bedroom. Tavren went back to the garden. Tavren went to the kitchen. Zorvik picked up the football. Zorvik put down the football. Zorvik discarded the milk. Tavren moved to the bathroom. Vaelis went back to the garden. Zorvik took the milk. Vaelis moved to the bathroom. Nelora moved to the garden. Tavren moved to the garden. Vaelis put down the apple.
Question
Where was the apple before the office?
Answer choices
- A. office
- B. bedroom
- C. hallway
- D. kitchen
- E. bathroom
- F. garden
Reference answer: E.
Exact evaluated input as JSON
{
"state": "Tavren went to the hallway.\nTavren went to the kitchen.\nNelora went back to the hallway.\nZorvik picked up the apple.\nZorvik went to the garden.\nTavren journeyed to the hallway.\nZorvik journeyed to the hallway.\nNelora moved to the office.\nTavren went back to the kitchen.\nZorvik discarded the apple there.\nZorvik picked up the apple.\nZorvik left the apple there.\nNelora went to the bedroom.\nNelora moved to the kitchen.\nZorvik grabbed the apple.\nTavren went to the garden.\nNelora moved to the office.\nTavren went to the bedroom.\nNelora went back to the bedroom.\nTavren journeyed to the hallway.\nTavren went to the bedroom.\nZorvik put down the apple.\nZorvik moved to the bedroom.\nNelora moved to the bathroom.\nZorvik moved to the bathroom.\nNelora travelled to the garden.\nNelora journeyed to the kitchen.\nVaelis journeyed to the hallway.\nVaelis travelled to the office.\nNelora travelled to the garden.\nZorvik got the milk.\nZorvik went back to the garden.\nNelora went back to the bedroom.\nZorvik went back to the kitchen.\nNelora travelled to the garden.\nTavren moved to the kitchen.\nVaelis journeyed to the bathroom.\nVaelis grabbed the football.\nZorvik went back to the office.\nZorvik moved to the kitchen.\nZorvik travelled to the office.\nVaelis went back to the hallway.\nZorvik discarded the milk.\nZorvik took the milk.\nVaelis dropped the football.\nTavren journeyed to the garden.\nZorvik discarded the milk.\nZorvik got the milk.\nZorvik left the milk.\nVaelis grabbed the football.\nTavren travelled to the bathroom.\nVaelis discarded the football.\nZorvik went to the bedroom.\nZorvik moved to the kitchen.\nVaelis picked up the football there.\nVaelis dropped the football.\nTavren travelled to the bedroom.\nVaelis moved to the office.\nVaelis went back to the bathroom.\nNelora went to the bathroom.\nTavren moved to the garden.\nZorvik went to the bedroom.\nVaelis went back to the hallway.\nVaelis took the apple.\nVaelis grabbed the football.\nVaelis dropped the apple.\nTavren travelled to the bathroom.\nNelora went back to the office.\nVaelis dropped the football there.\nTavren travelled to the office.\nZorvik travelled to the kitchen.\nVaelis got the apple.\nTavren picked up the milk.\nVaelis grabbed the football there.\nVaelis put down the football.\nVaelis moved to the garden.\nZorvik moved to the office.\nNelora moved to the bedroom.\nTavren dropped the milk.\nZorvik grabbed the milk.\nTavren moved to the bedroom.\nNelora travelled to the office.\nVaelis went back to the bathroom.\nZorvik went back to the hallway.\nVaelis went to the office.\nNelora journeyed to the bedroom.\nTavren went back to the garden.\nTavren went to the kitchen.\nZorvik picked up the football.\nZorvik put down the football.\nZorvik discarded the milk.\nTavren moved to the bathroom.\nVaelis went back to the garden.\nZorvik took the milk.\nVaelis moved to the bathroom.\nNelora moved to the garden.\nTavren moved to the garden.\nVaelis put down the apple.",
"question": "Where was the apple before the office? ",
"choices": {
"A": "office",
"B": "bedroom",
"C": "hallway",
"D": "kitchen",
"E": "bathroom",
"F": "garden"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | E — bathroom |
E — bathroom |
Same answer |
| Decider v1.1 | E — bathroom |
E — bathroom |
Same answer |
| Jev | E — bathroom |
E — bathroom |
Same answer |
| Microsoft Decision-1 | E — bathroom |
E — bathroom |
Same answer |
| Clef | E — bathroom |
C — hallway |
Different answer |
| Luna Decisions | C — hallway |
C — hallway |
Same answer |
| Clef Flash | F — garden |
C — hallway |
Different answer |
| Strands Decider | F — garden |
F — garden |
Same answer |
| GLiNER2.5 Decide | F — garden |
F — garden |
Same answer |
| Laya | A — office |
A — office |
Same answer |
| CalDec v1 | A — office |
A — office |
Same answer |
Identifiers and recorded conditions
Variant ID: babi/6d3842d1971d4be98e73/unfamiliar_names/invented
Input fingerprint: 7fb9aa56a1c0c746655168868400841d458ee8e3513a9c28329044dd16dd72fb
| Change | Recorded version |
|---|---|
| Invented names | Use invented names |
Source attribution and dataset terms are linked from the original question.