RaindropA practical guide to choosing decision modelsGitHub ↗

Invented names · Use invented names variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Read the full context

Tavren moved to the office. Vaelis moved to the garden. Nelora travelled to the office. Nelora went back to the hallway. Nelora moved to the garden. Zorvik travelled to the bedroom. Tavren took the milk there. Tavren left the milk. Tavren picked up the milk. Zorvik went to the hallway. Vaelis travelled to the kitchen. Tavren discarded the milk. Nelora went back to the bathroom. Tavren got the milk. Nelora picked up the football. Tavren put down the milk. Nelora moved to the office. Tavren travelled to the bathroom. Nelora grabbed the milk. Nelora moved to the garden. Zorvik went back to the bedroom. Nelora journeyed to the bedroom. Zorvik picked up the apple. Nelora went back to the kitchen. Tavren journeyed to the bedroom. Vaelis travelled to the bedroom. Zorvik left the apple there. Zorvik got the apple. Zorvik discarded the apple. Vaelis picked up the apple. Nelora went back to the office. Zorvik went back to the kitchen. Vaelis discarded the apple. Tavren grabbed the apple. Tavren went to the hallway. Vaelis moved to the garden. Zorvik went to the office. Nelora dropped the football. Tavren went to the garden. Vaelis moved to the kitchen. Vaelis moved to the garden. Tavren put down the apple there. Vaelis took the apple. Nelora journeyed to the garden. Zorvik went to the garden. Vaelis went back to the bedroom. Nelora travelled to the bedroom. Zorvik moved to the bedroom. Vaelis put down the apple. Tavren went back to the office. Vaelis took the apple. Tavren took the football. Nelora put down the milk there. Zorvik picked up the milk there. Zorvik put down the milk. Nelora grabbed the milk. Nelora dropped the milk there. Tavren left the football. Tavren went to the kitchen. Vaelis left the apple. Vaelis moved to the kitchen. Nelora took the milk. Zorvik picked up the apple. Zorvik discarded the apple. Zorvik grabbed the apple. Nelora left the milk. Zorvik picked up the milk there. Tavren moved to the bedroom. Nelora went to the hallway. Zorvik discarded the apple. Vaelis moved to the bathroom. Zorvik took the apple there. Vaelis journeyed to the hallway. Tavren moved to the hallway. Tavren went to the bathroom. Tavren went to the hallway. Zorvik moved to the office. Nelora journeyed to the bedroom. Vaelis went to the office. Zorvik picked up the football. Nelora moved to the office. Nelora moved to the hallway. Zorvik went back to the hallway. Nelora went back to the bathroom. Vaelis moved to the bedroom. Zorvik went back to the garden. Vaelis journeyed to the office. Nelora went back to the hallway. Zorvik put down the milk. Vaelis went to the hallway.

Question

Where was the milk before the hallway?

Answer choices

  • A. hallway
  • B. office
  • C. bedroom
  • D. bathroom
  • E. garden
  • F. kitchen

Reference answer: B.

Exact evaluated input as JSON
{
  "state": "Tavren moved to the office.\nVaelis moved to the garden.\nNelora travelled to the office.\nNelora went back to the hallway.\nNelora moved to the garden.\nZorvik travelled to the bedroom.\nTavren took the milk there.\nTavren left the milk.\nTavren picked up the milk.\nZorvik went to the hallway.\nVaelis travelled to the kitchen.\nTavren discarded the milk.\nNelora went back to the bathroom.\nTavren got the milk.\nNelora picked up the football.\nTavren put down the milk.\nNelora moved to the office.\nTavren travelled to the bathroom.\nNelora grabbed the milk.\nNelora moved to the garden.\nZorvik went back to the bedroom.\nNelora journeyed to the bedroom.\nZorvik picked up the apple.\nNelora went back to the kitchen.\nTavren journeyed to the bedroom.\nVaelis travelled to the bedroom.\nZorvik left the apple there.\nZorvik got the apple.\nZorvik discarded the apple.\nVaelis picked up the apple.\nNelora went back to the office.\nZorvik went back to the kitchen.\nVaelis discarded the apple.\nTavren grabbed the apple.\nTavren went to the hallway.\nVaelis moved to the garden.\nZorvik went to the office.\nNelora dropped the football.\nTavren went to the garden.\nVaelis moved to the kitchen.\nVaelis moved to the garden.\nTavren put down the apple there.\nVaelis took the apple.\nNelora journeyed to the garden.\nZorvik went to the garden.\nVaelis went back to the bedroom.\nNelora travelled to the bedroom.\nZorvik moved to the bedroom.\nVaelis put down the apple.\nTavren went back to the office.\nVaelis took the apple.\nTavren took the football.\nNelora put down the milk there.\nZorvik picked up the milk there.\nZorvik put down the milk.\nNelora grabbed the milk.\nNelora dropped the milk there.\nTavren left the football.\nTavren went to the kitchen.\nVaelis left the apple.\nVaelis moved to the kitchen.\nNelora took the milk.\nZorvik picked up the apple.\nZorvik discarded the apple.\nZorvik grabbed the apple.\nNelora left the milk.\nZorvik picked up the milk there.\nTavren moved to the bedroom.\nNelora went to the hallway.\nZorvik discarded the apple.\nVaelis moved to the bathroom.\nZorvik took the apple there.\nVaelis journeyed to the hallway.\nTavren moved to the hallway.\nTavren went to the bathroom.\nTavren went to the hallway.\nZorvik moved to the office.\nNelora journeyed to the bedroom.\nVaelis went to the office.\nZorvik picked up the football.\nNelora moved to the office.\nNelora moved to the hallway.\nZorvik went back to the hallway.\nNelora went back to the bathroom.\nVaelis moved to the bedroom.\nZorvik went back to the garden.\nVaelis journeyed to the office.\nNelora went back to the hallway.\nZorvik put down the milk.\nVaelis went to the hallway.",
  "question": "Where was the milk before the hallway? ",
  "choices": {
    "A": "hallway",
    "B": "office",
    "C": "bedroom",
    "D": "bathroom",
    "E": "garden",
    "F": "kitchen"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 E — garden E — garden Same answer
Decider v1.1 E — garden E — garden Same answer
Jev C — bedroom C — bedroom Same answer
Microsoft Decision-1 C — bedroom D — bathroom Different answer
Clef D — bathroom C — bedroom Different answer
Luna Decisions D — bathroom D — bathroom Same answer
Clef Flash D — bathroom D — bathroom Same answer
Strands Decider F — kitchen B — office Different answer
GLiNER2.5 Decide A — hallway E — garden Different answer
Laya B — office B — office Same answer
CalDec v1 C — bedroom B — office Different answer
Identifiers and recorded conditions

Variant ID: babi/a1f6c6ac025c82548034/unfamiliar_names/invented

Input fingerprint: c01cee78b346063b6a8ba8c5df10e9731ec2de47c1b5affd7f4f950e4779847d

Change Recorded version
Invented names Use invented names

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.