RaindropA practical guide to choosing decision modelsGitHub ↗

Evidence position · Place the relevant information in the middle variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

The poem is untitled. Its author is anonymous. John moved to the garden. John went to the bedroom. Mary went back to the kitchen. Sandra moved to the garden. Daniel journeyed to the hallway. John journeyed to the kitchen. John journeyed to the office. Daniel travelled to the garden. John journeyed to the garden. Sandra took the milk. Sandra put down the milk. Mary moved to the bathroom. Daniel grabbed the milk there. John moved to the bathroom. Daniel put down the milk. John got the football. Mary travelled to the office. Sandra got the milk. Sandra left the milk. Sandra journeyed to the kitchen. John left the football there. John went to the kitchen. Daniel went to the kitchen. John moved to the hallway. Daniel went to the hallway. Mary journeyed to the bathroom. Mary took the football. Mary moved to the office. Daniel took the apple. Mary discarded the football there. Sandra travelled to the bedroom. Daniel put down the apple. Daniel took the apple. Daniel moved to the garden. Daniel moved to the hallway. Mary grabbed the football. Mary travelled to the bedroom. Daniel went to the garden. Sandra journeyed to the bathroom. Mary discarded the football there. John moved to the kitchen. Daniel discarded the apple. Its narrator speaks in the first person. It contains a refrain.

Question

Where was the apple before the hallway?

Answer choices

  • A. bathroom
  • B. bedroom
  • C. office
  • D. kitchen
  • E. garden
  • F. hallway

Reference answer: E.

Exact evaluated input as JSON
{
  "state": "The poem is untitled.\nIts author is anonymous.\nJohn moved to the garden.\nJohn went to the bedroom.\nMary went back to the kitchen.\nSandra moved to the garden.\nDaniel journeyed to the hallway.\nJohn journeyed to the kitchen.\nJohn journeyed to the office.\nDaniel travelled to the garden.\nJohn journeyed to the garden.\nSandra took the milk.\nSandra put down the milk.\nMary moved to the bathroom.\nDaniel grabbed the milk there.\nJohn moved to the bathroom.\nDaniel put down the milk.\nJohn got the football.\nMary travelled to the office.\nSandra got the milk.\nSandra left the milk.\nSandra journeyed to the kitchen.\nJohn left the football there.\nJohn went to the kitchen.\nDaniel went to the kitchen.\nJohn moved to the hallway.\nDaniel went to the hallway.\nMary journeyed to the bathroom.\nMary took the football.\nMary moved to the office.\nDaniel took the apple.\nMary discarded the football there.\nSandra travelled to the bedroom.\nDaniel put down the apple.\nDaniel took the apple.\nDaniel moved to the garden.\nDaniel moved to the hallway.\nMary grabbed the football.\nMary travelled to the bedroom.\nDaniel went to the garden.\nSandra journeyed to the bathroom.\nMary discarded the football there.\nJohn moved to the kitchen.\nDaniel discarded the apple.\nIts narrator speaks in the first person.\nIt contains a refrain.",
  "question": "Where was the apple before the hallway? ",
  "choices": {
    "A": "bathroom",
    "B": "bedroom",
    "C": "office",
    "D": "kitchen",
    "E": "garden",
    "F": "hallway"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 E — garden E — garden Same answer
Decider v1.1 E — garden E — garden Same answer
Jev E — garden E — garden Same answer
Microsoft Decision-1 E — garden E — garden Same answer
Clef E — garden E — garden Same answer
Luna Decisions E — garden E — garden Same answer
Clef Flash F — hallway D — kitchen Different answer
Strands Decider E — garden E — garden Same answer
GLiNER2.5 Decide E — garden E — garden Same answer
Laya A — bathroom C — office Different answer
CalDec v1 C — office A — bathroom Different answer
Identifiers and recorded conditions

Variant ID: babi/0ebef6723a11f5e9f14c/evidence_position/middle/clean-source_first_babi_object_lengths_positions_full_0093

Input fingerprint: 50ae9dbed1399d6ad3b1d8bc460d6c4f4f8279f492a86924ccb78e48f11c7242

Change Recorded version
Evidence position Place the relevant information in the middle

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.