Invented names · Use invented names variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context, question instructions.
How the edits were constructed
Context
Aside from tidal flooding along rivers, the storm's effects were primarily concentrated along the coast. A buoy off the coast of Nova Scotia reported a wave height of 100.7 feet (30.7 m), the highest ever recorded in the province's offshore waters. In the middle of the storm, the fishing vessel Andrea Gail sank, killing her crew of six and inspiring the book, and later movie, The Zelvar Tempest. Off the shore of New York's Long Island, an Air National Guard helicopter ran out of fuel and crashed; four members of its crew were rescued and one was killed. Two people died after their boat sank off Staten Island. High waves swept two people to their deaths, one in Rhode Island and one in Puerto Rico, and another person was blown off a bridge to his death. The tropical cyclone that formed late in the storm's duration caused little impact, limited to power outages and slick roads; one person was killed in Newfoundland from a traffic accident related to the storm.
Question
did a helicopter crash in the zelvar tempest
Answer choices
- yes. Yes
- no. No
Reference answer: yes.
Exact evaluated input as JSON
{
"state": "Aside from tidal flooding along rivers, the storm's effects were primarily concentrated along the coast. A buoy off the coast of Nova Scotia reported a wave height of 100.7 feet (30.7 m), the highest ever recorded in the province's offshore waters. In the middle of the storm, the fishing vessel Andrea Gail sank, killing her crew of six and inspiring the book, and later movie, The Zelvar Tempest. Off the shore of New York's Long Island, an Air National Guard helicopter ran out of fuel and crashed; four members of its crew were rescued and one was killed. Two people died after their boat sank off Staten Island. High waves swept two people to their deaths, one in Rhode Island and one in Puerto Rico, and another person was blown off a bridge to his death. The tropical cyclone that formed late in the storm's duration caused little impact, limited to power outages and slick roads; one person was killed in Newfoundland from a traffic accident related to the storm.",
"question": "did a helicopter crash in the zelvar tempest",
"choices": {
"yes": "Yes",
"no": "No"
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | yes — Yes |
yes — Yes |
Same answer |
| Decider v1.1 | yes — Yes |
yes — Yes |
Same answer |
| Jev | yes — Yes |
yes — Yes |
Same answer |
| Microsoft Decision-1 | yes — Yes |
yes — Yes |
Same answer |
| Clef | yes — Yes |
yes — Yes |
Same answer |
| Luna Decisions | yes — Yes |
yes — Yes |
Same answer |
| Clef Flash | yes — Yes |
no — No |
Different answer |
| Strands Decider | yes — Yes |
yes — Yes |
Same answer |
| GLiNER2.5 Decide | yes — Yes |
yes — Yes |
Same answer |
| Laya | yes — Yes |
yes — Yes |
Same answer |
| CalDec v1 | yes — Yes |
yes — Yes |
Same answer |
Identifiers and recorded conditions
Variant ID: boolq/afa7bbd45dc6974db130/unfamiliar_names/invented
Input fingerprint: ae6b80bc29c3271636705daf7bb4df45bd3b929e18a3fdfff03c2e2bbfb5a889
| Change | Recorded version |
|---|---|
| Invented names | Use invented names |
Source attribution and dataset terms are linked from the original question.