RaindropA practical guide to choosing decision modelsGitHub ↗

Evidence position · Place the relevant information in the middle variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Read the full context

The poem is untitled. Its author is anonymous. Mary went back to the garden. John went back to the bedroom. Mary went back to the kitchen. Daniel travelled to the office. Mary moved to the bathroom. John travelled to the office. Mary got the football. Daniel journeyed to the hallway. Mary went to the hallway. Daniel travelled to the office. Mary travelled to the bedroom. Daniel moved to the bedroom. John journeyed to the garden. Mary dropped the football. Mary journeyed to the garden. Sandra travelled to the hallway. Daniel travelled to the kitchen. Sandra moved to the bedroom. Mary went to the bathroom. John moved to the bedroom. Sandra travelled to the hallway. Daniel moved to the hallway. Daniel got the milk. Mary travelled to the hallway. Mary journeyed to the kitchen. John went to the office. Daniel went to the kitchen. Daniel put down the milk. John moved to the bedroom. Sandra moved to the kitchen. Mary moved to the hallway. Sandra went to the bathroom. Daniel travelled to the garden. Mary went back to the office. Mary picked up the apple. John grabbed the football. John left the football there. Mary dropped the apple there. Sandra went back to the office. John went to the kitchen. Sandra took the apple. Sandra travelled to the hallway. John grabbed the milk there. Mary went back to the bedroom. Daniel journeyed to the office. Sandra discarded the apple. John journeyed to the garden. Daniel moved to the hallway. Sandra picked up the apple there. Sandra dropped the apple. Sandra travelled to the office. Daniel picked up the apple. Mary journeyed to the bathroom. Mary journeyed to the kitchen. Mary travelled to the bedroom. Mary took the football. Mary put down the football. Sandra went back to the garden. John dropped the milk. Sandra took the milk. John moved to the kitchen. Sandra journeyed to the bathroom. Sandra dropped the milk there. Sandra went to the hallway. Daniel went to the garden. John went to the bedroom. Daniel left the apple. John took the football. Sandra went back to the office. Daniel journeyed to the hallway. Sandra went back to the garden. Sandra went to the office. Sandra went to the garden. Mary went back to the kitchen. Sandra journeyed to the bathroom. Mary went to the garden. Sandra took the milk there. Mary journeyed to the hallway. Sandra went to the garden. Sandra discarded the milk there. John discarded the football. John grabbed the football. John dropped the football. Sandra moved to the hallway. John moved to the garden. John took the apple. John discarded the apple. John got the apple. Mary went to the kitchen. John journeyed to the kitchen. John went to the garden. Sandra journeyed to the bedroom. Its narrator speaks in the first person. It contains a refrain.

Question

Where was the apple before the garden?

Answer choices

  • A. bathroom
  • B. garden
  • C. bedroom
  • D. kitchen
  • E. hallway
  • F. office

Reference answer: D.

Exact evaluated input as JSON
{
  "state": "The poem is untitled.\nIts author is anonymous.\nMary went back to the garden.\nJohn went back to the bedroom.\nMary went back to the kitchen.\nDaniel travelled to the office.\nMary moved to the bathroom.\nJohn travelled to the office.\nMary got the football.\nDaniel journeyed to the hallway.\nMary went to the hallway.\nDaniel travelled to the office.\nMary travelled to the bedroom.\nDaniel moved to the bedroom.\nJohn journeyed to the garden.\nMary dropped the football.\nMary journeyed to the garden.\nSandra travelled to the hallway.\nDaniel travelled to the kitchen.\nSandra moved to the bedroom.\nMary went to the bathroom.\nJohn moved to the bedroom.\nSandra travelled to the hallway.\nDaniel moved to the hallway.\nDaniel got the milk.\nMary travelled to the hallway.\nMary journeyed to the kitchen.\nJohn went to the office.\nDaniel went to the kitchen.\nDaniel put down the milk.\nJohn moved to the bedroom.\nSandra moved to the kitchen.\nMary moved to the hallway.\nSandra went to the bathroom.\nDaniel travelled to the garden.\nMary went back to the office.\nMary picked up the apple.\nJohn grabbed the football.\nJohn left the football there.\nMary dropped the apple there.\nSandra went back to the office.\nJohn went to the kitchen.\nSandra took the apple.\nSandra travelled to the hallway.\nJohn grabbed the milk there.\nMary went back to the bedroom.\nDaniel journeyed to the office.\nSandra discarded the apple.\nJohn journeyed to the garden.\nDaniel moved to the hallway.\nSandra picked up the apple there.\nSandra dropped the apple.\nSandra travelled to the office.\nDaniel picked up the apple.\nMary journeyed to the bathroom.\nMary journeyed to the kitchen.\nMary travelled to the bedroom.\nMary took the football.\nMary put down the football.\nSandra went back to the garden.\nJohn dropped the milk.\nSandra took the milk.\nJohn moved to the kitchen.\nSandra journeyed to the bathroom.\nSandra dropped the milk there.\nSandra went to the hallway.\nDaniel went to the garden.\nJohn went to the bedroom.\nDaniel left the apple.\nJohn took the football.\nSandra went back to the office.\nDaniel journeyed to the hallway.\nSandra went back to the garden.\nSandra went to the office.\nSandra went to the garden.\nMary went back to the kitchen.\nSandra journeyed to the bathroom.\nMary went to the garden.\nSandra took the milk there.\nMary journeyed to the hallway.\nSandra went to the garden.\nSandra discarded the milk there.\nJohn discarded the football.\nJohn grabbed the football.\nJohn dropped the football.\nSandra moved to the hallway.\nJohn moved to the garden.\nJohn took the apple.\nJohn discarded the apple.\nJohn got the apple.\nMary went to the kitchen.\nJohn journeyed to the kitchen.\nJohn went to the garden.\nSandra journeyed to the bedroom.\nIts narrator speaks in the first person.\nIt contains a refrain.",
  "question": "Where was the apple before the garden? ",
  "choices": {
    "A": "bathroom",
    "B": "garden",
    "C": "bedroom",
    "D": "kitchen",
    "E": "hallway",
    "F": "office"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 D — kitchen D — kitchen Same answer
Decider v1.1 D — kitchen D — kitchen Same answer
Jev E — hallway E — hallway Same answer
Microsoft Decision-1 D — kitchen D — kitchen Same answer
Clef D — kitchen D — kitchen Same answer
Luna Decisions E — hallway E — hallway Same answer
Clef Flash E — hallway D — kitchen Different answer
Strands Decider B — garden D — kitchen Different answer
GLiNER2.5 Decide B — garden B — garden Same answer
Laya F — office D — kitchen Different answer
CalDec v1 B — garden D — kitchen Different answer
Identifiers and recorded conditions

Variant ID: babi/2755256213552c1db112/evidence_position/middle/clean-source_first_babi_object_lengths_positions_full_0093

Input fingerprint: db2f5d71fd13f595a1e3cac885456b34772f8646af197e4bb812e64aa6c1c581

Change Recorded version
Evidence position Place the relevant information in the middle

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.