Retrieval · question 51
Back to Retrieval · All capabilities
Question ID: boolq/23cb00cd216a6370aa39
Source: BoolQ
Input format: native choices
Explore this question’s altered versions
Context
A group of cats can be referred to as a clowder or a glaring; a male cat is called a tom or tomcat (or a gib, if neutered); an unspayed female is called a queen, especially in a cat-breeding context; and a juvenile cat is referred to as a kitten. The male progenitor of a cat, especially a pedigreed cat, is its sire, and its mother is its dam. In Early Modern English, the word kitten was interchangeable with the now obsolete word catling.
Question
is a group of cats known as a clowder
Answer choices
- yes: Yes
- no: No
Reference answer: Yes (yes)
Exact evaluated input as JSON
{
"state": "A group of cats can be referred to as a clowder or a glaring; a male cat is called a tom or tomcat (or a gib, if neutered); an unspayed female is called a queen, especially in a cat-breeding context; and a juvenile cat is referred to as a kitten. The male progenitor of a cat, especially a pedigreed cat, is its sire, and its mother is its dam. In Early Modern English, the word kitten was interchangeable with the now obsolete word catling.",
"question": "is a group of cats known as a clowder",
"choices": {
"yes": "Yes",
"no": "No"
}
}
Recorded model answers
| Model | Answer | Outcome |
|---|---|---|
| Astra | Yes | Correct |
| Opus 5.5 | Yes | Correct |
| GLiDE v1.2 | Yes | Correct |
| Decider v1.1 | Yes | Correct |
| Jev | Yes | Correct |
| Microsoft Decision-1 | Yes | Correct |
| Clef | Yes | Correct |
| Luna Decisions | Yes | Correct |
| Clef Flash | Yes | Correct |
| Strands Decider | Yes | Correct |
| GLiNER2.5 Decide | No | Incorrect |
| Laya | Yes | Correct |
| CalDec v1 | No | Incorrect |
Source and sharing
Original Wikipedia passage: Cat; contributor history. The BoolQ excerpt is unchanged. This question material retains CC BY-SA 3.0.
Attribution: Wikipedia contributors; Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, Kristina Toutanova (BoolQ).
Terms: CC-BY-SA-3.0. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.
Exact source locator and input fingerprint
{
"source_locator": {
"path": "data/validation-00000-of-00001.parquet",
"record": "3245",
"kind": "source_file_record"
},
"source_revision": "35b264d03638db9f4ce671b711558bf7ff0f80d5",
"input_hash": "cbad1d0ffb8a038b51fad5004496c67cf66352f8ae29339cf2ea6b91d899b93c"
}