Paraphrasing · Change individual words and phrases variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
Read the full context
Daniel went to the hallway. Daniel went to the kitchen. Mary returned to the hallway. John picked up the apple. John went to the garden. Daniel travelled to the hallway. John travelled to the hallway. Mary went to the office. Daniel returned to the kitchen. John discarded the apple there. John picked up the apple. John left the apple there. Mary went to the bedroom. Mary went to the kitchen. John grabbed the apple. Daniel went to the garden. Mary went to the office. Daniel went to the bedroom. Mary returned to the bedroom. Daniel travelled to the hallway. Daniel went to the bedroom. John put down the apple. John went to the bedroom. Mary went to the bathroom. John went to the bathroom. Mary journeyed to the garden. Mary travelled to the kitchen. Sandra travelled to the hallway. Sandra journeyed to the office. Mary journeyed to the garden. John got the milk. John returned to the garden. Mary returned to the bedroom. John returned to the kitchen. Mary journeyed to the garden. Daniel went to the kitchen. Sandra travelled to the bathroom. Sandra grabbed the football. John returned to the office. John went to the kitchen. John journeyed to the office. Sandra returned to the hallway. John discarded the milk. John took the milk. Sandra dropped the football. Daniel travelled to the garden. John discarded the milk. John got the milk. John left the milk. Sandra grabbed the football. Daniel journeyed to the bathroom. Sandra discarded the football. John went to the bedroom. John went to the kitchen. Sandra picked up the football there. Sandra dropped the football. Daniel journeyed to the bedroom. Sandra went to the office. Sandra returned to the bathroom. Mary went to the bathroom. Daniel went to the garden. John went to the bedroom. Sandra returned to the hallway. Sandra took the apple. Sandra grabbed the football. Sandra dropped the apple. Daniel journeyed to the bathroom. Mary returned to the office. Sandra dropped the football there. Daniel journeyed to the office. John journeyed to the kitchen. Sandra got the apple. Daniel picked up the milk. Sandra grabbed the football there. Sandra put down the football. Sandra went to the garden. John went to the office. Mary went to the bedroom. Daniel dropped the milk. John grabbed the milk. Daniel went to the bedroom. Mary journeyed to the office. Sandra returned to the bathroom. John returned to the hallway. Sandra went to the office. Mary travelled to the bedroom. Daniel returned to the garden. Daniel went to the kitchen. John picked up the football. John put down the football. John discarded the milk. Daniel went to the bathroom. Sandra returned to the garden. John took the milk. Sandra went to the bathroom. Mary went to the garden. Daniel went to the garden. Sandra put down the apple.
Question
Where was the apple before the office?
Answer choices
- A. office
- B. bedroom
- C. hallway
- D. kitchen
- E. bathroom
- F. garden
Reference answer: E.
Exact evaluated input as JSON
{
"state": "Daniel went to the hallway.\nDaniel went to the kitchen.\nMary returned to the hallway.\nJohn picked up the apple.\nJohn went to the garden.\nDaniel travelled to the hallway.\nJohn travelled to the hallway.\nMary went to the office.\nDaniel returned to the kitchen.\nJohn discarded the apple there.\nJohn picked up the apple.\nJohn left the apple there.\nMary went to the bedroom.\nMary went to the kitchen.\nJohn grabbed the apple.\nDaniel went to the garden.\nMary went to the office.\nDaniel went to the bedroom.\nMary returned to the bedroom.\nDaniel travelled to the hallway.\nDaniel went to the bedroom.\nJohn put down the apple.\nJohn went to the bedroom.\nMary went to the bathroom.\nJohn went to the bathroom.\nMary journeyed to the garden.\nMary travelled to the kitchen.\nSandra travelled to the hallway.\nSandra journeyed to the office.\nMary journeyed to the garden.\nJohn got the milk.\nJohn returned to the garden.\nMary returned to the bedroom.\nJohn returned to the kitchen.\nMary journeyed to the garden.\nDaniel went to the kitchen.\nSandra travelled to the bathroom.\nSandra grabbed the football.\nJohn returned to the office.\nJohn went to the kitchen.\nJohn journeyed to the office.\nSandra returned to the hallway.\nJohn discarded the milk.\nJohn took the milk.\nSandra dropped the football.\nDaniel travelled to the garden.\nJohn discarded the milk.\nJohn got the milk.\nJohn left the milk.\nSandra grabbed the football.\nDaniel journeyed to the bathroom.\nSandra discarded the football.\nJohn went to the bedroom.\nJohn went to the kitchen.\nSandra picked up the football there.\nSandra dropped the football.\nDaniel journeyed to the bedroom.\nSandra went to the office.\nSandra returned to the bathroom.\nMary went to the bathroom.\nDaniel went to the garden.\nJohn went to the bedroom.\nSandra returned to the hallway.\nSandra took the apple.\nSandra grabbed the football.\nSandra dropped the apple.\nDaniel journeyed to the bathroom.\nMary returned to the office.\nSandra dropped the football there.\nDaniel journeyed to the office.\nJohn journeyed to the kitchen.\nSandra got the apple.\nDaniel picked up the milk.\nSandra grabbed the football there.\nSandra put down the football.\nSandra went to the garden.\nJohn went to the office.\nMary went to the bedroom.\nDaniel dropped the milk.\nJohn grabbed the milk.\nDaniel went to the bedroom.\nMary journeyed to the office.\nSandra returned to the bathroom.\nJohn returned to the hallway.\nSandra went to the office.\nMary travelled to the bedroom.\nDaniel returned to the garden.\nDaniel went to the kitchen.\nJohn picked up the football.\nJohn put down the football.\nJohn discarded the milk.\nDaniel went to the bathroom.\nSandra returned to the garden.\nJohn took the milk.\nSandra went to the bathroom.\nMary went to the garden.\nDaniel went to the garden.\nSandra put down the apple.",
"question": "Where was the apple before the office? ",
"choices": {
"A": "office",
"B": "bedroom",
"C": "hallway",
"D": "kitchen",
"E": "bathroom",
"F": "garden"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | E — bathroom |
E — bathroom |
Same answer |
| Decider v1.1 | E — bathroom |
E — bathroom |
Same answer |
| Jev | E — bathroom |
C — hallway |
Different answer |
| Microsoft Decision-1 | E — bathroom |
E — bathroom |
Same answer |
| Clef | E — bathroom |
C — hallway |
Different answer |
| Luna Decisions | C — hallway |
C — hallway |
Same answer |
| Clef Flash | F — garden |
D — kitchen |
Different answer |
| Strands Decider | F — garden |
F — garden |
Same answer |
| GLiNER2.5 Decide | F — garden |
F — garden |
Same answer |
| Laya | A — office |
A — office |
Same answer |
| CalDec v1 | A — office |
A — office |
Same answer |
Identifiers and recorded conditions
Variant ID: babi/6d3842d1971d4be98e73/paraphrasing/surface
Input fingerprint: f9da4a8eb237177888e9e146ddc211b3ee68bfd949dd50478c6bf3649766d128
| Change | Recorded version |
|---|---|
| Paraphrasing | Change individual words and phrases |
Source attribution and dataset terms are linked from the original question.