RaindropA practical guide to choosing decision modelsGitHub ↗

Irrelevant details · Add a small amount of irrelevant detail variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

The musical suite Merovan includes a refrain.

Aside from tidal flooding along rivers, the storm's effects were primarily concentrated along the coast. A buoy off the coast of Nova Scotia reported a wave height of 100.7 feet (30.7 m), the highest ever recorded in the province's offshore waters. In the middle of the storm, the fishing vessel Andrea Gail sank, killing her crew of six and inspiring the book, and later movie, The Perfect Storm. Off the shore of New York's Long Island, an Air National Guard helicopter ran out of fuel and crashed; four members of its crew were rescued and one was killed. Two people died after their boat sank off Staten Island. High waves swept two people to their deaths, one in Rhode Island and one in Puerto Rico, and another person was blown off a bridge to his death. The tropical cyclone that formed late in the storm's duration caused little impact, limited to power outages and slick roads; one person was killed in Newfoundland from a traffic accident related to the storm.

Question

did a helicopter crash in the perfect storm

Answer choices

  • yes. Yes
  • no. No

Reference answer: yes.

Exact evaluated input as JSON
{
  "state": "The musical suite Merovan includes a refrain.\n\nAside from tidal flooding along rivers, the storm's effects were primarily concentrated along the coast. A buoy off the coast of Nova Scotia reported a wave height of 100.7 feet (30.7 m), the highest ever recorded in the province's offshore waters. In the middle of the storm, the fishing vessel Andrea Gail sank, killing her crew of six and inspiring the book, and later movie, The Perfect Storm. Off the shore of New York's Long Island, an Air National Guard helicopter ran out of fuel and crashed; four members of its crew were rescued and one was killed. Two people died after their boat sank off Staten Island. High waves swept two people to their deaths, one in Rhode Island and one in Puerto Rico, and another person was blown off a bridge to his death. The tropical cyclone that formed late in the storm's duration caused little impact, limited to power outages and slick roads; one person was killed in Newfoundland from a traffic accident related to the storm.",
  "question": "did a helicopter crash in the perfect storm",
  "choices": {
    "yes": "Yes",
    "no": "No"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 yes — Yes yes — Yes Same answer
Decider v1.1 yes — Yes yes — Yes Same answer
Jev yes — Yes yes — Yes Same answer
Microsoft Decision-1 yes — Yes yes — Yes Same answer
Clef yes — Yes yes — Yes Same answer
Luna Decisions yes — Yes yes — Yes Same answer
Clef Flash yes — Yes yes — Yes Same answer
Strands Decider yes — Yes yes — Yes Same answer
GLiNER2.5 Decide yes — Yes yes — Yes Same answer
Laya yes — Yes yes — Yes Same answer
CalDec v1 yes — Yes yes — Yes Same answer
Identifiers and recorded conditions

Variant ID: boolq/afa7bbd45dc6974db130/irrelevant_details/low/clean-source_first_boolq_music_contexts_full_0164

Input fingerprint: b8f5e7c2a758009099e3ad7e46f0fe1c47abbc6ecb4c1640e381090003ea5219

Change Recorded version
Irrelevant details Add a small amount of irrelevant detail

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.