Paraphrasing · Change individual words and phrases variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
Read the full context
Mary went to the office. Sandra travelled to the kitchen. Mary returned to the bedroom. Daniel went to the office. Mary took the milk. Sandra went to the hallway. Mary picked up the football. Daniel went to the garden. Daniel went to the bathroom. Sandra travelled to the bedroom. Mary journeyed to the hallway. John went to the bathroom. Mary discarded the milk there. Mary put down the football. Mary journeyed to the kitchen. Sandra travelled to the garden. Daniel returned to the hallway. Daniel grabbed the football. Sandra journeyed to the hallway. Daniel left the football. Sandra returned to the garden. Mary returned to the bedroom. Sandra returned to the kitchen. Sandra journeyed to the hallway. Mary returned to the office. Daniel journeyed to the garden. Mary travelled to the bathroom. Sandra grabbed the milk. Sandra discarded the milk. John went to the hallway. Sandra returned to the office. John took the football. John dropped the football. Daniel travelled to the kitchen. John journeyed to the garden. Daniel returned to the bathroom. Sandra journeyed to the bedroom. Daniel went to the garden. Daniel journeyed to the bathroom. Daniel returned to the office. Daniel went to the bathroom. Daniel went to the hallway. Daniel grabbed the football there. Mary travelled to the garden. Sandra journeyed to the garden. Mary returned to the bedroom. Mary journeyed to the hallway. John travelled to the hallway. Daniel grabbed the milk there. Sandra went to the hallway. Sandra journeyed to the garden. John grabbed the apple. John discarded the apple. John journeyed to the office. John returned to the hallway. John got the apple. Sandra travelled to the hallway. Mary returned to the office. Mary journeyed to the kitchen. John dropped the apple. John took the apple. John went to the kitchen. Daniel discarded the milk. Daniel went to the garden. John left the apple there. Daniel journeyed to the kitchen. Sandra journeyed to the bathroom. John got the apple. Daniel left the football. John got the football. Sandra returned to the bedroom. John went to the hallway. John discarded the apple. John discarded the football. Sandra went to the hallway. John journeyed to the office. Sandra took the apple. Mary journeyed to the hallway. Mary picked up the football. Mary went to the bathroom. Daniel went to the hallway. Mary returned to the garden. Sandra got the milk. John went to the bedroom. Daniel journeyed to the kitchen. Mary discarded the football. Mary went to the hallway. John journeyed to the hallway. Daniel returned to the bedroom. Sandra dropped the milk. Sandra got the milk. Mary went to the bathroom. Sandra left the apple there. Sandra discarded the milk. Sandra journeyed to the office. Sandra journeyed to the kitchen. Daniel returned to the bathroom. Sandra went to the hallway. John grabbed the milk. Daniel travelled to the kitchen. Sandra journeyed to the office. John took the apple. John journeyed to the kitchen. John journeyed to the office.
Question
Where was the apple before the office?
Answer choices
- A. kitchen
- B. bathroom
- C. bedroom
- D. hallway
- E. office
- F. garden
Reference answer: A.
Exact evaluated input as JSON
{
"state": "Mary went to the office.\nSandra travelled to the kitchen.\nMary returned to the bedroom.\nDaniel went to the office.\nMary took the milk.\nSandra went to the hallway.\nMary picked up the football.\nDaniel went to the garden.\nDaniel went to the bathroom.\nSandra travelled to the bedroom.\nMary journeyed to the hallway.\nJohn went to the bathroom.\nMary discarded the milk there.\nMary put down the football.\nMary journeyed to the kitchen.\nSandra travelled to the garden.\nDaniel returned to the hallway.\nDaniel grabbed the football.\nSandra journeyed to the hallway.\nDaniel left the football.\nSandra returned to the garden.\nMary returned to the bedroom.\nSandra returned to the kitchen.\nSandra journeyed to the hallway.\nMary returned to the office.\nDaniel journeyed to the garden.\nMary travelled to the bathroom.\nSandra grabbed the milk.\nSandra discarded the milk.\nJohn went to the hallway.\nSandra returned to the office.\nJohn took the football.\nJohn dropped the football.\nDaniel travelled to the kitchen.\nJohn journeyed to the garden.\nDaniel returned to the bathroom.\nSandra journeyed to the bedroom.\nDaniel went to the garden.\nDaniel journeyed to the bathroom.\nDaniel returned to the office.\nDaniel went to the bathroom.\nDaniel went to the hallway.\nDaniel grabbed the football there.\nMary travelled to the garden.\nSandra journeyed to the garden.\nMary returned to the bedroom.\nMary journeyed to the hallway.\nJohn travelled to the hallway.\nDaniel grabbed the milk there.\nSandra went to the hallway.\nSandra journeyed to the garden.\nJohn grabbed the apple.\nJohn discarded the apple.\nJohn journeyed to the office.\nJohn returned to the hallway.\nJohn got the apple.\nSandra travelled to the hallway.\nMary returned to the office.\nMary journeyed to the kitchen.\nJohn dropped the apple.\nJohn took the apple.\nJohn went to the kitchen.\nDaniel discarded the milk.\nDaniel went to the garden.\nJohn left the apple there.\nDaniel journeyed to the kitchen.\nSandra journeyed to the bathroom.\nJohn got the apple.\nDaniel left the football.\nJohn got the football.\nSandra returned to the bedroom.\nJohn went to the hallway.\nJohn discarded the apple.\nJohn discarded the football.\nSandra went to the hallway.\nJohn journeyed to the office.\nSandra took the apple.\nMary journeyed to the hallway.\nMary picked up the football.\nMary went to the bathroom.\nDaniel went to the hallway.\nMary returned to the garden.\nSandra got the milk.\nJohn went to the bedroom.\nDaniel journeyed to the kitchen.\nMary discarded the football.\nMary went to the hallway.\nJohn journeyed to the hallway.\nDaniel returned to the bedroom.\nSandra dropped the milk.\nSandra got the milk.\nMary went to the bathroom.\nSandra left the apple there.\nSandra discarded the milk.\nSandra journeyed to the office.\nSandra journeyed to the kitchen.\nDaniel returned to the bathroom.\nSandra went to the hallway.\nJohn grabbed the milk.\nDaniel travelled to the kitchen.\nSandra journeyed to the office.\nJohn took the apple.\nJohn journeyed to the kitchen.\nJohn journeyed to the office.",
"question": "Where was the apple before the office? ",
"choices": {
"A": "kitchen",
"B": "bathroom",
"C": "bedroom",
"D": "hallway",
"E": "office",
"F": "garden"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | A — kitchen |
A — kitchen |
Same answer |
| Decider v1.1 | A — kitchen |
A — kitchen |
Same answer |
| Jev | A — kitchen |
A — kitchen |
Same answer |
| Microsoft Decision-1 | A — kitchen |
A — kitchen |
Same answer |
| Clef | A — kitchen |
A — kitchen |
Same answer |
| Luna Decisions | D — hallway |
D — hallway |
Same answer |
| Clef Flash | A — kitchen |
A — kitchen |
Same answer |
| Strands Decider | A — kitchen |
A — kitchen |
Same answer |
| GLiNER2.5 Decide | E — office |
F — garden |
Different answer |
| Laya | A — kitchen |
A — kitchen |
Same answer |
| CalDec v1 | E — office |
E — office |
Same answer |
Identifiers and recorded conditions
Variant ID: babi/94b56fad9ffb1fb6bffd/paraphrasing/surface
Input fingerprint: 6869a7ed28913a593d2d4243ca9555ebfaf5859889996cdfe208f7e62a3f03aa
| Change | Recorded version |
|---|---|
| Paraphrasing | Change individual words and phrases |
Source attribution and dataset terms are linked from the original question.