RaindropA practical guide to choosing decision modelsGitHub ↗

Invented names · Use invented names variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Read the full context

Zorvik went to the hallway. Nelora took the apple. Zorvik took the football. Nelora dropped the apple. Vaelis went to the kitchen. Nelora went back to the kitchen. Zorvik left the football there. Zorvik took the football. Vaelis travelled to the garden. Zorvik put down the football. Zorvik got the football. Nelora journeyed to the hallway. Vaelis went to the office. Tavren travelled to the kitchen. Zorvik dropped the football. Zorvik got the football. Zorvik discarded the football. Nelora went to the bedroom. Tavren moved to the bathroom. Nelora went back to the bathroom. Zorvik picked up the football. Zorvik discarded the football. Zorvik got the football. Zorvik went to the bedroom. Zorvik put down the football there. Tavren journeyed to the kitchen. Vaelis went back to the bathroom. Tavren went to the bedroom. Vaelis moved to the garden. Zorvik went back to the hallway. Zorvik travelled to the office. Vaelis got the apple. Tavren went to the hallway. Nelora journeyed to the hallway. Vaelis took the milk. Vaelis journeyed to the kitchen. Tavren went back to the office. Vaelis put down the apple. Tavren moved to the bedroom. Zorvik went to the garden. Zorvik travelled to the bathroom. Tavren got the football. Tavren travelled to the office. Tavren discarded the football. Vaelis took the apple. Vaelis discarded the apple. Tavren journeyed to the garden. Zorvik went back to the kitchen. Zorvik went back to the office. Zorvik went to the bathroom. Vaelis discarded the milk. Vaelis journeyed to the bedroom. Vaelis journeyed to the garden. Nelora went to the garden. Vaelis travelled to the bathroom. Tavren travelled to the bathroom. Vaelis moved to the office. Vaelis travelled to the hallway. Vaelis moved to the bathroom. Tavren journeyed to the office. Vaelis travelled to the office. Vaelis journeyed to the garden. Zorvik moved to the bedroom. Vaelis journeyed to the hallway. Tavren went to the hallway. Tavren went back to the bedroom. Nelora travelled to the bathroom. Nelora went to the garden. Nelora went to the kitchen. Nelora got the milk. Zorvik travelled to the bathroom. Nelora got the apple. Nelora journeyed to the office. Vaelis journeyed to the bathroom. Zorvik went back to the kitchen. Nelora put down the milk. Nelora journeyed to the garden. Nelora went to the hallway. Nelora journeyed to the kitchen. Vaelis moved to the hallway. Nelora moved to the bedroom. Tavren went to the kitchen. Nelora left the apple. Tavren journeyed to the bathroom. Nelora picked up the apple. Nelora journeyed to the garden. Zorvik travelled to the hallway. Nelora travelled to the hallway. Nelora travelled to the bedroom. Vaelis moved to the bedroom. Nelora discarded the apple. Vaelis grabbed the apple. Vaelis went back to the bathroom. Zorvik journeyed to the office. Zorvik picked up the milk. Vaelis went back to the kitchen. Zorvik journeyed to the kitchen. Nelora journeyed to the office. Tavren journeyed to the garden. Tavren went back to the kitchen. Nelora went to the hallway. Vaelis went back to the bathroom. Vaelis dropped the apple there. Zorvik journeyed to the office.

Question

Where was the apple before the bathroom?

Answer choices

  • A. bathroom
  • B. bedroom
  • C. hallway
  • D. kitchen
  • E. garden
  • F. office

Reference answer: D.

Exact evaluated input as JSON
{
  "state": "Zorvik went to the hallway.\nNelora took the apple.\nZorvik took the football.\nNelora dropped the apple.\nVaelis went to the kitchen.\nNelora went back to the kitchen.\nZorvik left the football there.\nZorvik took the football.\nVaelis travelled to the garden.\nZorvik put down the football.\nZorvik got the football.\nNelora journeyed to the hallway.\nVaelis went to the office.\nTavren travelled to the kitchen.\nZorvik dropped the football.\nZorvik got the football.\nZorvik discarded the football.\nNelora went to the bedroom.\nTavren moved to the bathroom.\nNelora went back to the bathroom.\nZorvik picked up the football.\nZorvik discarded the football.\nZorvik got the football.\nZorvik went to the bedroom.\nZorvik put down the football there.\nTavren journeyed to the kitchen.\nVaelis went back to the bathroom.\nTavren went to the bedroom.\nVaelis moved to the garden.\nZorvik went back to the hallway.\nZorvik travelled to the office.\nVaelis got the apple.\nTavren went to the hallway.\nNelora journeyed to the hallway.\nVaelis took the milk.\nVaelis journeyed to the kitchen.\nTavren went back to the office.\nVaelis put down the apple.\nTavren moved to the bedroom.\nZorvik went to the garden.\nZorvik travelled to the bathroom.\nTavren got the football.\nTavren travelled to the office.\nTavren discarded the football.\nVaelis took the apple.\nVaelis discarded the apple.\nTavren journeyed to the garden.\nZorvik went back to the kitchen.\nZorvik went back to the office.\nZorvik went to the bathroom.\nVaelis discarded the milk.\nVaelis journeyed to the bedroom.\nVaelis journeyed to the garden.\nNelora went to the garden.\nVaelis travelled to the bathroom.\nTavren travelled to the bathroom.\nVaelis moved to the office.\nVaelis travelled to the hallway.\nVaelis moved to the bathroom.\nTavren journeyed to the office.\nVaelis travelled to the office.\nVaelis journeyed to the garden.\nZorvik moved to the bedroom.\nVaelis journeyed to the hallway.\nTavren went to the hallway.\nTavren went back to the bedroom.\nNelora travelled to the bathroom.\nNelora went to the garden.\nNelora went to the kitchen.\nNelora got the milk.\nZorvik travelled to the bathroom.\nNelora got the apple.\nNelora journeyed to the office.\nVaelis journeyed to the bathroom.\nZorvik went back to the kitchen.\nNelora put down the milk.\nNelora journeyed to the garden.\nNelora went to the hallway.\nNelora journeyed to the kitchen.\nVaelis moved to the hallway.\nNelora moved to the bedroom.\nTavren went to the kitchen.\nNelora left the apple.\nTavren journeyed to the bathroom.\nNelora picked up the apple.\nNelora journeyed to the garden.\nZorvik travelled to the hallway.\nNelora travelled to the hallway.\nNelora travelled to the bedroom.\nVaelis moved to the bedroom.\nNelora discarded the apple.\nVaelis grabbed the apple.\nVaelis went back to the bathroom.\nZorvik journeyed to the office.\nZorvik picked up the milk.\nVaelis went back to the kitchen.\nZorvik journeyed to the kitchen.\nNelora journeyed to the office.\nTavren journeyed to the garden.\nTavren went back to the kitchen.\nNelora went to the hallway.\nVaelis went back to the bathroom.\nVaelis dropped the apple there.\nZorvik journeyed to the office.",
  "question": "Where was the apple before the bathroom? ",
  "choices": {
    "A": "bathroom",
    "B": "bedroom",
    "C": "hallway",
    "D": "kitchen",
    "E": "garden",
    "F": "office"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 D — kitchen D — kitchen Same answer
Decider v1.1 D — kitchen D — kitchen Same answer
Jev B — bedroom B — bedroom Same answer
Microsoft Decision-1 D — kitchen D — kitchen Same answer
Clef D — kitchen D — kitchen Same answer
Luna Decisions E — garden D — kitchen Different answer
Clef Flash C — hallway D — kitchen Different answer
Strands Decider E — garden C — hallway Different answer
GLiNER2.5 Decide F — office F — office Same answer
Laya F — office F — office Same answer
CalDec v1 B — bedroom F — office Different answer
Identifiers and recorded conditions

Variant ID: babi/0c88dca89e4fa2c3cb4f/unfamiliar_names/invented

Input fingerprint: ba9ce1994ad8b9dc27fc111e9db2bbd0dd79fa0dc1cd59e2198d645ed090124e

Change Recorded version
Invented names Use invented names

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.