RaindropA practical guide to choosing decision modelsGitHub ↗

Invented names · Use invented names variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context, question instructions.

How the edits were constructed

Context

Vaelis moved to the bedroom. Tavren journeyed to the garden. Nelora moved to the bedroom. Vaelis went back to the hallway. Zorvik went to the office. Vaelis went back to the bathroom.

Question

Where is Tavren?

Answer choices

  • A. bathroom
  • B. garden
  • C. kitchen
  • D. office
  • E. bedroom
  • F. hallway

Reference answer: B.

Exact evaluated input as JSON
{
  "state": "Vaelis moved to the bedroom.\nTavren journeyed to the garden.\nNelora moved to the bedroom.\nVaelis went back to the hallway.\nZorvik went to the office.\nVaelis went back to the bathroom.",
  "question": "Where is Tavren? ",
  "choices": {
    "A": "bathroom",
    "B": "garden",
    "C": "kitchen",
    "D": "office",
    "E": "bedroom",
    "F": "hallway"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 B — garden B — garden Same answer
Decider v1.1 B — garden B — garden Same answer
Jev B — garden B — garden Same answer
Microsoft Decision-1 B — garden B — garden Same answer
Clef B — garden B — garden Same answer
Luna Decisions B — garden B — garden Same answer
Clef Flash B — garden B — garden Same answer
Strands Decider B — garden B — garden Same answer
GLiNER2.5 Decide A — bathroom A — bathroom Same answer
Laya A — bathroom A — bathroom Same answer
CalDec v1 A — bathroom A — bathroom Same answer
Identifiers and recorded conditions

Variant ID: babi/cc3432e648d116c87be2/unfamiliar_names/invented

Input fingerprint: a91d6bff515f84010a2dfae4436ecce04ca89ac24834d8319bad53362d99b26a

Change Recorded version
Invented names Use invented names

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.