RaindropA practical guide to choosing decision modelsGitHub ↗

Retrieval · question 22

Back to Retrieval · All capabilities

Question ID: boolq/afa7bbd45dc6974db130
Source: BoolQ
Input format: native choices

Explore this question’s altered versions

Context

Aside from tidal flooding along rivers, the storm's effects were primarily concentrated along the coast. A buoy off the coast of Nova Scotia reported a wave height of 100.7 feet (30.7 m), the highest ever recorded in the province's offshore waters. In the middle of the storm, the fishing vessel Andrea Gail sank, killing her crew of six and inspiring the book, and later movie, The Perfect Storm. Off the shore of New York's Long Island, an Air National Guard helicopter ran out of fuel and crashed; four members of its crew were rescued and one was killed. Two people died after their boat sank off Staten Island. High waves swept two people to their deaths, one in Rhode Island and one in Puerto Rico, and another person was blown off a bridge to his death. The tropical cyclone that formed late in the storm's duration caused little impact, limited to power outages and slick roads; one person was killed in Newfoundland from a traffic accident related to the storm.

Question

did a helicopter crash in the perfect storm

Answer choices

  • yes: Yes
  • no: No

Reference answer: Yes (yes)

Exact evaluated input as JSON
{
  "state": "Aside from tidal flooding along rivers, the storm's effects were primarily concentrated along the coast. A buoy off the coast of Nova Scotia reported a wave height of 100.7 feet (30.7 m), the highest ever recorded in the province's offshore waters. In the middle of the storm, the fishing vessel Andrea Gail sank, killing her crew of six and inspiring the book, and later movie, The Perfect Storm. Off the shore of New York's Long Island, an Air National Guard helicopter ran out of fuel and crashed; four members of its crew were rescued and one was killed. Two people died after their boat sank off Staten Island. High waves swept two people to their deaths, one in Rhode Island and one in Puerto Rico, and another person was blown off a bridge to his death. The tropical cyclone that formed late in the storm's duration caused little impact, limited to power outages and slick roads; one person was killed in Newfoundland from a traffic accident related to the storm.",
  "question": "did a helicopter crash in the perfect storm",
  "choices": {
    "yes": "Yes",
    "no": "No"
  }
}

Recorded model answers

Model Answer Outcome
Astra Yes Correct
Opus 5.5 Yes Correct
GLiDE v1.2 Yes Correct
Decider v1.1 Yes Correct
Jev Yes Correct
Microsoft Decision-1 Yes Correct
Clef Yes Correct
Luna Decisions Yes Correct
Clef Flash Yes Correct
Strands Decider Yes Correct
GLiNER2.5 Decide Yes Correct
Laya Yes Correct
CalDec v1 Yes Correct

Source and sharing

Original Wikipedia passage: 1991 Perfect Storm; contributor history. The BoolQ excerpt is unchanged. This question material retains CC BY-SA 3.0.

Attribution: Wikipedia contributors; Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, Kristina Toutanova (BoolQ).
Terms: CC-BY-SA-3.0. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.

Exact source locator and input fingerprint
{
  "source_locator": {
    "path": "data/validation-00000-of-00001.parquet",
    "record": "2148",
    "kind": "source_file_record"
  },
  "source_revision": "35b264d03638db9f4ce671b711558bf7ff0f80d5",
  "input_hash": "f997980b1fcac6640535a69066969197209ec44f2a6a6affb3c15bbed07ea9c5"
}

Type to search questions, variants and documentation.