Misleading details · Add an unverified claim that agrees with the evidence variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
A reader thinks: «An Air National Guard helicopter crashed off Long Island during the storm described in the passage.»
Aside from tidal flooding along rivers, the storm's effects were primarily concentrated along the coast. A buoy off the coast of Nova Scotia reported a wave height of 100.7 feet (30.7 m), the highest ever recorded in the province's offshore waters. In the middle of the storm, the fishing vessel Andrea Gail sank, killing her crew of six and inspiring the book, and later movie, The Perfect Storm. Off the shore of New York's Long Island, an Air National Guard helicopter ran out of fuel and crashed; four members of its crew were rescued and one was killed. Two people died after their boat sank off Staten Island. High waves swept two people to their deaths, one in Rhode Island and one in Puerto Rico, and another person was blown off a bridge to his death. The tropical cyclone that formed late in the storm's duration caused little impact, limited to power outages and slick roads; one person was killed in Newfoundland from a traffic accident related to the storm.
Question
did a helicopter crash in the perfect storm
Answer choices
- yes. Yes
- no. No
Reference answer: yes.
Exact evaluated input as JSON
{
"state": "A reader thinks: «An Air National Guard helicopter crashed off Long Island during the storm described in the passage.»\n\nAside from tidal flooding along rivers, the storm's effects were primarily concentrated along the coast. A buoy off the coast of Nova Scotia reported a wave height of 100.7 feet (30.7 m), the highest ever recorded in the province's offshore waters. In the middle of the storm, the fishing vessel Andrea Gail sank, killing her crew of six and inspiring the book, and later movie, The Perfect Storm. Off the shore of New York's Long Island, an Air National Guard helicopter ran out of fuel and crashed; four members of its crew were rescued and one was killed. Two people died after their boat sank off Staten Island. High waves swept two people to their deaths, one in Rhode Island and one in Puerto Rico, and another person was blown off a bridge to his death. The tropical cyclone that formed late in the storm's duration caused little impact, limited to power outages and slick roads; one person was killed in Newfoundland from a traffic accident related to the storm.",
"question": "did a helicopter crash in the perfect storm",
"choices": {
"yes": "Yes",
"no": "No"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | yes — Yes |
yes — Yes |
Same answer |
| Decider v1.1 | yes — Yes |
yes — Yes |
Same answer |
| Jev | yes — Yes |
yes — Yes |
Same answer |
| Microsoft Decision-1 | yes — Yes |
yes — Yes |
Same answer |
| Clef | yes — Yes |
yes — Yes |
Same answer |
| Luna Decisions | yes — Yes |
yes — Yes |
Same answer |
| Clef Flash | yes — Yes |
yes — Yes |
Same answer |
| Strands Decider | yes — Yes |
yes — Yes |
Same answer |
| GLiNER2.5 Decide | yes — Yes |
yes — Yes |
Same answer |
| Laya | yes — Yes |
yes — Yes |
Same answer |
| CalDec v1 | yes — Yes |
yes — Yes |
Same answer |
Identifiers and recorded conditions
Variant ID: boolq/afa7bbd45dc6974db130/misleading_summary/accurate/clean-source_first_boolq_music_contexts_full_0164
Input fingerprint: 69e93da389af16717b85d862f2f736793f045b08f45b511815689af3faa50c87
| Change | Recorded version |
|---|---|
| Misleading details | Add an unverified claim that agrees with the evidence |
Source attribution and dataset terms are linked from the original question.