Concepts and categorization · question 2
Back to Concepts and categorization · All capabilities
Question ID: mnli/ba47e276b2b7b8b7fd71
Source: MNLI
Input format: native choices
Explore this question’s altered versions
Context
That would be a tenfold increase in the Internet's share.
Question
Does the premise entail, contradict, or leave undetermined this statement? That would cause the Internet's share to rise by a factor of ten.
Answer choices
- 0: Entailment
- 1: Neither entailed nor contradicted
- 2: Contradiction
Reference answer: Entailment (0)
Exact evaluated input as JSON
{
"state": "That would be a tenfold increase in the Internet's share.",
"question": "Does the premise entail, contradict, or leave undetermined this statement? That would cause the Internet's share to rise by a factor of ten.",
"choices": {
"0": "Entailment",
"1": "Neither entailed nor contradicted",
"2": "Contradiction"
}
}
Recorded model answers
| Model | Answer | Outcome |
|---|---|---|
| Astra | Entailment | Correct |
| Opus 5.5 | Entailment | Correct |
| GLiDE v1.2 | Entailment | Correct |
| Decider v1.1 | Entailment | Correct |
| Jev | Entailment | Correct |
| Microsoft Decision-1 | Entailment | Correct |
| Clef | Entailment | Correct |
| Luna Decisions | Neither entailed nor contradicted | Incorrect |
| Clef Flash | Entailment | Correct |
| Strands Decider | Entailment | Correct |
| GLiNER2.5 Decide | Neither entailed nor contradicted | Incorrect |
| Laya | Entailment | Correct |
| CalDec v1 | Entailment | Correct |
Source and sharing
Original MultiNLI pair: 25200e; OANC genre: slate. Transparent modification: selected excerpts and format normalization by Raindrop, 2026-11-09. Premise wording is unchanged. The original unmodified sentence pair is identified by pairID in the MultiNLI 1.0 release, available from the source URL. No source endorsement is implied.
Attribution: Adina Williams, Nikita Nangia, Samuel R. Bowman (MultiNLI); Slate Magazine; Copyright (c) 1996-2000 Microsoft Corporation.
Terms: OANC (selected non-fiction genres). Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.
Exact source locator and input fingerprint
{
"source_locator": {
"path": "data/validation_matched-00000-of-00001.parquet",
"record": "7840",
"kind": "source_file_record"
},
"source_revision": "da70db2af9d09693783c3320c4249840212ee221",
"input_hash": "7053f0151e93d87fcebc62b07201f049debd0c01b1cf8a6b3a49a14db8cd4ecb"
}