RaindropA practical guide to choosing decision modelsGitHub ↗

Invented names · Use invented names variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Nelora got the milk. Zorvik journeyed to the office. Nelora discarded the milk. Nelora took the milk. Zorvik went to the bathroom. Nelora left the milk. Tavren went to the garden. Vaelis moved to the garden. Vaelis went to the bathroom. Tavren went back to the bedroom. Vaelis got the football. Vaelis discarded the football. Nelora got the milk there. Zorvik moved to the office. Tavren went to the hallway. Vaelis journeyed to the garden. Nelora left the milk. Tavren went back to the bedroom. Tavren took the milk. Tavren left the milk. Nelora moved to the kitchen. Nelora went back to the bathroom. Zorvik journeyed to the bedroom. Tavren went back to the office. Nelora took the football. Nelora discarded the football. Nelora grabbed the football. Zorvik journeyed to the office. Nelora put down the football. Nelora took the football. Nelora journeyed to the hallway. Nelora left the football. Nelora picked up the apple. Vaelis moved to the hallway. Vaelis took the football. Nelora went back to the garden. Nelora left the apple. Vaelis went to the office. Tavren journeyed to the garden. Zorvik went back to the bathroom. Nelora went back to the office. Tavren grabbed the apple. Nelora went back to the bathroom. Zorvik travelled to the kitchen. Nelora journeyed to the kitchen. Nelora moved to the bathroom. Vaelis went to the kitchen. Vaelis left the football.

Question

Where was the football before the kitchen?

Answer choices

  • A. bathroom
  • B. hallway
  • C. kitchen
  • D. bedroom
  • E. office
  • F. garden

Reference answer: E.

Exact evaluated input as JSON
{
  "state": "Nelora got the milk.\nZorvik journeyed to the office.\nNelora discarded the milk.\nNelora took the milk.\nZorvik went to the bathroom.\nNelora left the milk.\nTavren went to the garden.\nVaelis moved to the garden.\nVaelis went to the bathroom.\nTavren went back to the bedroom.\nVaelis got the football.\nVaelis discarded the football.\nNelora got the milk there.\nZorvik moved to the office.\nTavren went to the hallway.\nVaelis journeyed to the garden.\nNelora left the milk.\nTavren went back to the bedroom.\nTavren took the milk.\nTavren left the milk.\nNelora moved to the kitchen.\nNelora went back to the bathroom.\nZorvik journeyed to the bedroom.\nTavren went back to the office.\nNelora took the football.\nNelora discarded the football.\nNelora grabbed the football.\nZorvik journeyed to the office.\nNelora put down the football.\nNelora took the football.\nNelora journeyed to the hallway.\nNelora left the football.\nNelora picked up the apple.\nVaelis moved to the hallway.\nVaelis took the football.\nNelora went back to the garden.\nNelora left the apple.\nVaelis went to the office.\nTavren journeyed to the garden.\nZorvik went back to the bathroom.\nNelora went back to the office.\nTavren grabbed the apple.\nNelora went back to the bathroom.\nZorvik travelled to the kitchen.\nNelora journeyed to the kitchen.\nNelora moved to the bathroom.\nVaelis went to the kitchen.\nVaelis left the football.",
  "question": "Where was the football before the kitchen? ",
  "choices": {
    "A": "bathroom",
    "B": "hallway",
    "C": "kitchen",
    "D": "bedroom",
    "E": "office",
    "F": "garden"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 E — office E — office Same answer
Decider v1.1 E — office E — office Same answer
Jev E — office E — office Same answer
Microsoft Decision-1 E — office E — office Same answer
Clef E — office E — office Same answer
Luna Decisions B — hallway B — hallway Same answer
Clef Flash B — hallway B — hallway Same answer
Strands Decider B — hallway B — hallway Same answer
GLiNER2.5 Decide F — garden F — garden Same answer
Laya A — bathroom A — bathroom Same answer
CalDec v1 A — bathroom C — kitchen Different answer
Identifiers and recorded conditions

Variant ID: babi/93021258c6ea2e72208f/unfamiliar_names/invented

Input fingerprint: b6c55d889a02aede42005116dda69613002df7722a1857a38402ec084dbda555

Change Recorded version
Invented names Use invented names

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.