Retrieval · question 61
Back to Retrieval · All capabilities
Question ID: boolq/81a93c346c08d802f3e1
Source: BoolQ
Input format: native choices
Explore this question’s altered versions
Context
The Mercedes-Benz Stadium is a multi-purpose retractable roof stadium located in Atlanta, Georgia. The home of the Atlanta Falcons of the National Football League (NFL) and Atlanta United FC of Major League Soccer (MLS), it replaced the adjacent Georgia Dome, the Falcons' home stadium for a quarter century, from 1992 through 2016. This stadium holds the record of the world's largest halo board and is one of few stadiums with retractable roofs.
Question
did the atlanta falcons get a new stadium
Answer choices
- yes: Yes
- no: No
Reference answer: Yes (yes)
Exact evaluated input as JSON
{
"state": "The Mercedes-Benz Stadium is a multi-purpose retractable roof stadium located in Atlanta, Georgia. The home of the Atlanta Falcons of the National Football League (NFL) and Atlanta United FC of Major League Soccer (MLS), it replaced the adjacent Georgia Dome, the Falcons' home stadium for a quarter century, from 1992 through 2016. This stadium holds the record of the world's largest halo board and is one of few stadiums with retractable roofs.",
"question": "did the atlanta falcons get a new stadium",
"choices": {
"yes": "Yes",
"no": "No"
}
}
Recorded model answers
| Model | Answer | Outcome |
|---|---|---|
| Astra | Yes | Correct |
| Opus 5.5 | Yes | Correct |
| GLiDE v1.2 | Yes | Correct |
| Decider v1.1 | Yes | Correct |
| Jev | Yes | Correct |
| Microsoft Decision-1 | Yes | Correct |
| Clef | Yes | Correct |
| Luna Decisions | Yes | Correct |
| Clef Flash | Yes | Correct |
| Strands Decider | Yes | Correct |
| GLiNER2.5 Decide | Yes | Correct |
| Laya | Yes | Correct |
| CalDec v1 | Yes | Correct |
Source and sharing
Original Wikipedia passage: Mercedes-Benz Stadium; contributor history. The BoolQ excerpt is unchanged. This question material retains CC BY-SA 3.0.
Attribution: Wikipedia contributors; Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, Kristina Toutanova (BoolQ).
Terms: CC-BY-SA-3.0. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.
Exact source locator and input fingerprint
{
"source_locator": {
"path": "data/train-00000-of-00001.parquet",
"record": "7786",
"kind": "source_file_record"
},
"source_revision": "35b264d03638db9f4ce671b711558bf7ff0f80d5",
"input_hash": "945f19c5a06f5b34c9d63938d9e92be71e24430e95fe0211d15564c871f1bf3b"
}