RaindropA practical guide to choosing decision modelsGitHub ↗

Evidence order · Present the events in reverse chronological order variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Read the full context

Daniel discarded the apple. Before that, John moved to the kitchen. Before that, Mary discarded the football there. Before that, Sandra journeyed to the bathroom. Before that, Daniel went to the garden. Before that, Mary travelled to the bedroom. Before that, Mary grabbed the football. Before that, Daniel moved to the hallway. Before that, Daniel moved to the garden. Before that, Daniel took the apple. Before that, Daniel put down the apple. Before that, Sandra travelled to the bedroom. Before that, Mary discarded the football there. Before that, Daniel took the apple. Before that, Mary moved to the office. Before that, Mary took the football. Before that, Mary journeyed to the bathroom. Before that, Daniel went to the hallway. Before that, John moved to the hallway. Before that, Daniel went to the kitchen. Before that, John went to the kitchen. Before that, John left the football there. Before that, Sandra journeyed to the kitchen. Before that, Sandra left the milk. Before that, Sandra got the milk. Before that, Mary travelled to the office. Before that, John got the football. Before that, Daniel put down the milk. Before that, John moved to the bathroom. Before that, Daniel grabbed the milk there. Before that, Mary moved to the bathroom. Before that, Sandra put down the milk. Before that, Sandra took the milk. Before that, John journeyed to the garden. Before that, Daniel travelled to the garden. Before that, John journeyed to the office. Before that, John journeyed to the kitchen. Before that, Daniel journeyed to the hallway. Before that, Sandra moved to the garden. Before that, Mary went back to the kitchen. Before that, John went to the bedroom. Before that, John moved to the garden.

Question

Where was the apple before the hallway?

Answer choices

  • A. bathroom
  • B. bedroom
  • C. office
  • D. kitchen
  • E. garden
  • F. hallway

Reference answer: E.

Exact evaluated input as JSON
{
  "state": "Daniel discarded the apple.\nBefore that, John moved to the kitchen.\nBefore that, Mary discarded the football there.\nBefore that, Sandra journeyed to the bathroom.\nBefore that, Daniel went to the garden.\nBefore that, Mary travelled to the bedroom.\nBefore that, Mary grabbed the football.\nBefore that, Daniel moved to the hallway.\nBefore that, Daniel moved to the garden.\nBefore that, Daniel took the apple.\nBefore that, Daniel put down the apple.\nBefore that, Sandra travelled to the bedroom.\nBefore that, Mary discarded the football there.\nBefore that, Daniel took the apple.\nBefore that, Mary moved to the office.\nBefore that, Mary took the football.\nBefore that, Mary journeyed to the bathroom.\nBefore that, Daniel went to the hallway.\nBefore that, John moved to the hallway.\nBefore that, Daniel went to the kitchen.\nBefore that, John went to the kitchen.\nBefore that, John left the football there.\nBefore that, Sandra journeyed to the kitchen.\nBefore that, Sandra left the milk.\nBefore that, Sandra got the milk.\nBefore that, Mary travelled to the office.\nBefore that, John got the football.\nBefore that, Daniel put down the milk.\nBefore that, John moved to the bathroom.\nBefore that, Daniel grabbed the milk there.\nBefore that, Mary moved to the bathroom.\nBefore that, Sandra put down the milk.\nBefore that, Sandra took the milk.\nBefore that, John journeyed to the garden.\nBefore that, Daniel travelled to the garden.\nBefore that, John journeyed to the office.\nBefore that, John journeyed to the kitchen.\nBefore that, Daniel journeyed to the hallway.\nBefore that, Sandra moved to the garden.\nBefore that, Mary went back to the kitchen.\nBefore that, John went to the bedroom.\nBefore that, John moved to the garden.",
  "question": "Where was the apple before the hallway? ",
  "choices": {
    "A": "bathroom",
    "B": "bedroom",
    "C": "office",
    "D": "kitchen",
    "E": "garden",
    "F": "hallway"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 E — garden E — garden Same answer
Decider v1.1 E — garden E — garden Same answer
Jev E — garden E — garden Same answer
Microsoft Decision-1 E — garden E — garden Same answer
Clef E — garden E — garden Same answer
Luna Decisions E — garden E — garden Same answer
Clef Flash F — hallway E — garden Different answer
Strands Decider E — garden D — kitchen Different answer
GLiNER2.5 Decide E — garden E — garden Same answer
Laya A — bathroom A — bathroom Same answer
CalDec v1 C — office B — bedroom Different answer

Ordering comparison: coupled wording reference chronology or representation. Only the exact matched comparison sets contribute to the reported ordering contrasts.

Identifiers and recorded conditions

Variant ID: babi/0ebef6723a11f5e9f14c/presentation_order/full_reverse_chronology/clean-source_first_babi_full_reverse_repairs_full_0179

Input fingerprint: 648497a4c0782de528d57d100213bb69e045e7a1ea08553a20cdf748c58f55fa

Change Recorded version
Evidence order Present the events in reverse chronological order

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.