RaindropA practical guide to choosing decision modelsGitHub ↗

Paraphrasing · Change individual words and phrases variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Read the full context

Mary went to the office. Sandra travelled to the kitchen. Mary returned to the bedroom. Daniel went to the office. Mary took the milk. Sandra went to the hallway. Mary picked up the football. Daniel went to the garden. Daniel went to the bathroom. Sandra travelled to the bedroom. Mary journeyed to the hallway. John went to the bathroom. Mary discarded the milk there. Mary put down the football. Mary journeyed to the kitchen. Sandra travelled to the garden. Daniel returned to the hallway. Daniel grabbed the football. Sandra journeyed to the hallway. Daniel left the football. Sandra returned to the garden. Mary returned to the bedroom. Sandra returned to the kitchen. Sandra journeyed to the hallway. Mary returned to the office. Daniel journeyed to the garden. Mary travelled to the bathroom. Sandra grabbed the milk. Sandra discarded the milk. John went to the hallway. Sandra returned to the office. John took the football. John dropped the football. Daniel travelled to the kitchen. John journeyed to the garden. Daniel returned to the bathroom. Sandra journeyed to the bedroom. Daniel went to the garden. Daniel journeyed to the bathroom. Daniel returned to the office. Daniel went to the bathroom. Daniel went to the hallway. Daniel grabbed the football there. Mary travelled to the garden. Sandra journeyed to the garden. Mary returned to the bedroom. Mary journeyed to the hallway. John travelled to the hallway. Daniel grabbed the milk there. Sandra went to the hallway. Sandra journeyed to the garden. John grabbed the apple. John discarded the apple. John journeyed to the office. John returned to the hallway. John got the apple. Sandra travelled to the hallway. Mary returned to the office. Mary journeyed to the kitchen. John dropped the apple. John took the apple. John went to the kitchen. Daniel discarded the milk. Daniel went to the garden. John left the apple there. Daniel journeyed to the kitchen. Sandra journeyed to the bathroom. John got the apple. Daniel left the football. John got the football. Sandra returned to the bedroom. John went to the hallway. John discarded the apple. John discarded the football. Sandra went to the hallway. John journeyed to the office. Sandra took the apple. Mary journeyed to the hallway. Mary picked up the football. Mary went to the bathroom. Daniel went to the hallway. Mary returned to the garden. Sandra got the milk. John went to the bedroom. Daniel journeyed to the kitchen. Mary discarded the football. Mary went to the hallway. John journeyed to the hallway. Daniel returned to the bedroom. Sandra dropped the milk. Sandra got the milk. Mary went to the bathroom. Sandra left the apple there. Sandra discarded the milk. Sandra journeyed to the office. Sandra journeyed to the kitchen. Daniel returned to the bathroom. Sandra went to the hallway. John grabbed the milk. Daniel travelled to the kitchen. Sandra journeyed to the office. John took the apple. John journeyed to the kitchen. John journeyed to the office.

Question

Where was the apple before the office?

Answer choices

  • A. kitchen
  • B. bathroom
  • C. bedroom
  • D. hallway
  • E. office
  • F. garden

Reference answer: A.

Exact evaluated input as JSON
{
  "state": "Mary went to the office.\nSandra travelled to the kitchen.\nMary returned to the bedroom.\nDaniel went to the office.\nMary took the milk.\nSandra went to the hallway.\nMary picked up the football.\nDaniel went to the garden.\nDaniel went to the bathroom.\nSandra travelled to the bedroom.\nMary journeyed to the hallway.\nJohn went to the bathroom.\nMary discarded the milk there.\nMary put down the football.\nMary journeyed to the kitchen.\nSandra travelled to the garden.\nDaniel returned to the hallway.\nDaniel grabbed the football.\nSandra journeyed to the hallway.\nDaniel left the football.\nSandra returned to the garden.\nMary returned to the bedroom.\nSandra returned to the kitchen.\nSandra journeyed to the hallway.\nMary returned to the office.\nDaniel journeyed to the garden.\nMary travelled to the bathroom.\nSandra grabbed the milk.\nSandra discarded the milk.\nJohn went to the hallway.\nSandra returned to the office.\nJohn took the football.\nJohn dropped the football.\nDaniel travelled to the kitchen.\nJohn journeyed to the garden.\nDaniel returned to the bathroom.\nSandra journeyed to the bedroom.\nDaniel went to the garden.\nDaniel journeyed to the bathroom.\nDaniel returned to the office.\nDaniel went to the bathroom.\nDaniel went to the hallway.\nDaniel grabbed the football there.\nMary travelled to the garden.\nSandra journeyed to the garden.\nMary returned to the bedroom.\nMary journeyed to the hallway.\nJohn travelled to the hallway.\nDaniel grabbed the milk there.\nSandra went to the hallway.\nSandra journeyed to the garden.\nJohn grabbed the apple.\nJohn discarded the apple.\nJohn journeyed to the office.\nJohn returned to the hallway.\nJohn got the apple.\nSandra travelled to the hallway.\nMary returned to the office.\nMary journeyed to the kitchen.\nJohn dropped the apple.\nJohn took the apple.\nJohn went to the kitchen.\nDaniel discarded the milk.\nDaniel went to the garden.\nJohn left the apple there.\nDaniel journeyed to the kitchen.\nSandra journeyed to the bathroom.\nJohn got the apple.\nDaniel left the football.\nJohn got the football.\nSandra returned to the bedroom.\nJohn went to the hallway.\nJohn discarded the apple.\nJohn discarded the football.\nSandra went to the hallway.\nJohn journeyed to the office.\nSandra took the apple.\nMary journeyed to the hallway.\nMary picked up the football.\nMary went to the bathroom.\nDaniel went to the hallway.\nMary returned to the garden.\nSandra got the milk.\nJohn went to the bedroom.\nDaniel journeyed to the kitchen.\nMary discarded the football.\nMary went to the hallway.\nJohn journeyed to the hallway.\nDaniel returned to the bedroom.\nSandra dropped the milk.\nSandra got the milk.\nMary went to the bathroom.\nSandra left the apple there.\nSandra discarded the milk.\nSandra journeyed to the office.\nSandra journeyed to the kitchen.\nDaniel returned to the bathroom.\nSandra went to the hallway.\nJohn grabbed the milk.\nDaniel travelled to the kitchen.\nSandra journeyed to the office.\nJohn took the apple.\nJohn journeyed to the kitchen.\nJohn journeyed to the office.",
  "question": "Where was the apple before the office? ",
  "choices": {
    "A": "kitchen",
    "B": "bathroom",
    "C": "bedroom",
    "D": "hallway",
    "E": "office",
    "F": "garden"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 A — kitchen A — kitchen Same answer
Decider v1.1 A — kitchen A — kitchen Same answer
Jev A — kitchen A — kitchen Same answer
Microsoft Decision-1 A — kitchen A — kitchen Same answer
Clef A — kitchen A — kitchen Same answer
Luna Decisions D — hallway D — hallway Same answer
Clef Flash A — kitchen A — kitchen Same answer
Strands Decider A — kitchen A — kitchen Same answer
GLiNER2.5 Decide E — office F — garden Different answer
Laya A — kitchen A — kitchen Same answer
CalDec v1 E — office E — office Same answer
Identifiers and recorded conditions

Variant ID: babi/94b56fad9ffb1fb6bffd/paraphrasing/surface

Input fingerprint: 6869a7ed28913a593d2d4243ca9555ebfaf5859889996cdfe208f7e62a3f03aa

Change Recorded version
Paraphrasing Change individual words and phrases

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.