RaindropA practical guide to choosing decision modelsGitHub ↗

Invented names · Use invented names variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Read the full context

Tavren travelled to the kitchen. Vaelis travelled to the garden. Vaelis picked up the apple there. Nelora journeyed to the kitchen. Tavren got the milk. Vaelis picked up the football. Nelora moved to the bedroom. Tavren went back to the bedroom. Zorvik journeyed to the hallway. Nelora journeyed to the bathroom. Nelora went back to the hallway. Zorvik moved to the office. Vaelis went to the kitchen. Nelora journeyed to the bedroom. Tavren left the milk. Nelora moved to the kitchen. Zorvik went back to the bedroom. Tavren went back to the office. Vaelis went back to the hallway. Zorvik grabbed the milk. Vaelis went back to the kitchen. Tavren went to the bedroom. Zorvik journeyed to the hallway. Zorvik dropped the milk. Vaelis discarded the apple. Nelora grabbed the apple. Vaelis put down the football. Vaelis got the football. Vaelis went to the garden. Nelora travelled to the office. Vaelis dropped the football. Nelora went to the garden. Nelora left the apple there. Zorvik travelled to the kitchen. Vaelis got the apple. Nelora travelled to the bedroom. Vaelis left the apple. Vaelis went to the bathroom. Tavren moved to the office. Vaelis moved to the garden. Zorvik went back to the office. Vaelis took the football. Vaelis took the apple. Vaelis discarded the football. Tavren went to the bathroom. Nelora travelled to the office. Vaelis picked up the football. Vaelis discarded the apple. Vaelis left the football. Vaelis went to the office. Vaelis travelled to the bedroom. Zorvik went to the hallway. Zorvik journeyed to the bedroom. Zorvik went to the kitchen. Nelora travelled to the bathroom. Nelora moved to the kitchen. Tavren journeyed to the hallway. Tavren got the milk. Tavren dropped the milk. Zorvik went back to the bathroom. Nelora journeyed to the bedroom. Vaelis went to the garden. Vaelis took the apple. Tavren took the milk. Tavren dropped the milk there. Vaelis got the football. Zorvik journeyed to the hallway. Nelora went to the hallway. Tavren grabbed the milk. Tavren went to the office. Vaelis put down the apple. Tavren put down the milk. Vaelis journeyed to the bedroom. Vaelis discarded the football. Tavren got the milk. Tavren discarded the milk there. Nelora went back to the office. Nelora grabbed the milk. Tavren moved to the bathroom. Zorvik travelled to the kitchen. Tavren went to the hallway. Nelora moved to the bedroom. Vaelis travelled to the kitchen. Zorvik moved to the bedroom. Nelora put down the milk. Vaelis travelled to the garden. Nelora picked up the milk. Vaelis picked up the apple. Nelora moved to the garden. Vaelis journeyed to the kitchen. Tavren travelled to the office. Nelora went to the hallway. Nelora travelled to the kitchen. Vaelis dropped the apple there. Nelora travelled to the bathroom. Vaelis got the apple. Nelora went to the bedroom. Nelora picked up the football there. Nelora put down the milk. Zorvik travelled to the office. Zorvik travelled to the bedroom. Vaelis discarded the apple.

Question

Where was the milk before the kitchen?

Answer choices

  • A. bathroom
  • B. garden
  • C. kitchen
  • D. bedroom
  • E. office
  • F. hallway

Reference answer: F.

Exact evaluated input as JSON
{
  "state": "Tavren travelled to the kitchen.\nVaelis travelled to the garden.\nVaelis picked up the apple there.\nNelora journeyed to the kitchen.\nTavren got the milk.\nVaelis picked up the football.\nNelora moved to the bedroom.\nTavren went back to the bedroom.\nZorvik journeyed to the hallway.\nNelora journeyed to the bathroom.\nNelora went back to the hallway.\nZorvik moved to the office.\nVaelis went to the kitchen.\nNelora journeyed to the bedroom.\nTavren left the milk.\nNelora moved to the kitchen.\nZorvik went back to the bedroom.\nTavren went back to the office.\nVaelis went back to the hallway.\nZorvik grabbed the milk.\nVaelis went back to the kitchen.\nTavren went to the bedroom.\nZorvik journeyed to the hallway.\nZorvik dropped the milk.\nVaelis discarded the apple.\nNelora grabbed the apple.\nVaelis put down the football.\nVaelis got the football.\nVaelis went to the garden.\nNelora travelled to the office.\nVaelis dropped the football.\nNelora went to the garden.\nNelora left the apple there.\nZorvik travelled to the kitchen.\nVaelis got the apple.\nNelora travelled to the bedroom.\nVaelis left the apple.\nVaelis went to the bathroom.\nTavren moved to the office.\nVaelis moved to the garden.\nZorvik went back to the office.\nVaelis took the football.\nVaelis took the apple.\nVaelis discarded the football.\nTavren went to the bathroom.\nNelora travelled to the office.\nVaelis picked up the football.\nVaelis discarded the apple.\nVaelis left the football.\nVaelis went to the office.\nVaelis travelled to the bedroom.\nZorvik went to the hallway.\nZorvik journeyed to the bedroom.\nZorvik went to the kitchen.\nNelora travelled to the bathroom.\nNelora moved to the kitchen.\nTavren journeyed to the hallway.\nTavren got the milk.\nTavren dropped the milk.\nZorvik went back to the bathroom.\nNelora journeyed to the bedroom.\nVaelis went to the garden.\nVaelis took the apple.\nTavren took the milk.\nTavren dropped the milk there.\nVaelis got the football.\nZorvik journeyed to the hallway.\nNelora went to the hallway.\nTavren grabbed the milk.\nTavren went to the office.\nVaelis put down the apple.\nTavren put down the milk.\nVaelis journeyed to the bedroom.\nVaelis discarded the football.\nTavren got the milk.\nTavren discarded the milk there.\nNelora went back to the office.\nNelora grabbed the milk.\nTavren moved to the bathroom.\nZorvik travelled to the kitchen.\nTavren went to the hallway.\nNelora moved to the bedroom.\nVaelis travelled to the kitchen.\nZorvik moved to the bedroom.\nNelora put down the milk.\nVaelis travelled to the garden.\nNelora picked up the milk.\nVaelis picked up the apple.\nNelora moved to the garden.\nVaelis journeyed to the kitchen.\nTavren travelled to the office.\nNelora went to the hallway.\nNelora travelled to the kitchen.\nVaelis dropped the apple there.\nNelora travelled to the bathroom.\nVaelis got the apple.\nNelora went to the bedroom.\nNelora picked up the football there.\nNelora put down the milk.\nZorvik travelled to the office.\nZorvik travelled to the bedroom.\nVaelis discarded the apple.",
  "question": "Where was the milk before the kitchen? ",
  "choices": {
    "A": "bathroom",
    "B": "garden",
    "C": "kitchen",
    "D": "bedroom",
    "E": "office",
    "F": "hallway"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 F — hallway F — hallway Same answer
Decider v1.1 F — hallway F — hallway Same answer
Jev F — hallway F — hallway Same answer
Microsoft Decision-1 A — bathroom A — bathroom Same answer
Clef D — bedroom D — bedroom Same answer
Luna Decisions F — hallway F — hallway Same answer
Clef Flash C — kitchen C — kitchen Same answer
Strands Decider C — kitchen E — office Different answer
GLiNER2.5 Decide E — office E — office Same answer
Laya C — kitchen E — office Different answer
CalDec v1 D — bedroom D — bedroom Same answer
Identifiers and recorded conditions

Variant ID: babi/1f9d7560760759a7d86e/unfamiliar_names/invented

Input fingerprint: 5532ee3bd5f4efb9174eaf9cf0961cb963c0f14d44903afc350e4ae9dbd760c4

Change Recorded version
Invented names Use invented names

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.