RaindropA practical guide to choosing decision modelsGitHub ↗

Invented names · Use invented names variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: question instructions.

How the edits were constructed

Question

Varelin, Zorven, Nelarik, Tovrin, Kasel, Mireth, and Dazorin are friends and avid readers who occasionally trade books. At the start of the semester, they each buy one new book: Varelin gets The Odyssey, Zorven gets The Great Gatsby, Nelarik gets Lolita, Tovrin gets The Pearl, Kasel gets The Fellowship of the Ring, Mireth gets Frankenstein, and Dazorin gets Hound of the Baskervilles. As the semester proceeds, they start trading around the new books. First, Nelarik and Zorven swap books. Then, Varelin and Tovrin swap books. Then, Dazorin and Mireth swap books. Then, Zorven and Varelin swap books. Then, Varelin and Kasel swap books. Then, Tovrin and Dazorin swap books. Finally, Tovrin and Kasel swap books. At the end of the semester, Dazorin has

Answer choices

  • A. The Odyssey
  • B. The Great Gatsby
  • C. Lolita
  • D. The Pearl
  • E. The Fellowship of the Ring
  • F. Frankenstein
  • G. Hound of the Baskervilles

Reference answer: A.

Exact evaluated input as JSON
{
  "state": "",
  "question": "Varelin, Zorven, Nelarik, Tovrin, Kasel, Mireth, and Dazorin are friends and avid readers who occasionally trade books. At the start of the semester, they each buy one new book: Varelin gets The Odyssey, Zorven gets The Great Gatsby, Nelarik gets Lolita, Tovrin gets The Pearl, Kasel gets The Fellowship of the Ring, Mireth gets Frankenstein, and Dazorin gets Hound of the Baskervilles.\nAs the semester proceeds, they start trading around the new books. First, Nelarik and Zorven swap books. Then, Varelin and Tovrin swap books. Then, Dazorin and Mireth swap books. Then, Zorven and Varelin swap books. Then, Varelin and Kasel swap books. Then, Tovrin and Dazorin swap books. Finally, Tovrin and Kasel swap books. At the end of the semester, Dazorin has",
  "choices": {
    "A": "The Odyssey",
    "B": "The Great Gatsby",
    "C": "Lolita",
    "D": "The Pearl",
    "E": "The Fellowship of the Ring",
    "F": "Frankenstein",
    "G": "Hound of the Baskervilles"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 A — The Odyssey A — The Odyssey Same answer
Decider v1.1 D — The Pearl F — Frankenstein Different answer
Jev A — The Odyssey A — The Odyssey Same answer
Microsoft Decision-1 A — The Odyssey A — The Odyssey Same answer
Clef F — Frankenstein F — Frankenstein Same answer
Luna Decisions F — Frankenstein F — Frankenstein Same answer
Clef Flash D — The Pearl D — The Pearl Same answer
Strands Decider F — Frankenstein G — Hound of the Baskervilles Different answer
GLiNER2.5 Decide A — The Odyssey A — The Odyssey Same answer
Laya G — Hound of the Baskervilles G — Hound of the Baskervilles Same answer
CalDec v1 G — Hound of the Baskervilles D — The Pearl Different answer
Identifiers and recorded conditions

Variant ID: bbh/98c1222d144a429e0fc0/unfamiliar_names/invented

Input fingerprint: a0c1e82827b96c7326052340c3096d60edd79744decf3280a037ba3a8579d272

Change Recorded version
Invented names Use invented names

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.