Concepts and categorization · question 28
Back to Concepts and categorization · All capabilities
Question ID: mnli/5310cdb49b087a272917
Source: MNLI
Input format: native choices
Explore this question’s altered versions
Context
On the other hand, one would hate to lose the information that might be contained in past years' selling patterns.
Question
Does the premise entail, contradict, or leave undetermined this statement? It would be unfortunate to lose information that shows past years' selling patterns.
Answer choices
- 0: Entailment
- 1: Neither entailed nor contradicted
- 2: Contradiction
Reference answer: Entailment (0)
Exact evaluated input as JSON
{
"state": "On the other hand, one would hate to lose the information that might be contained in past years' selling patterns.",
"question": "Does the premise entail, contradict, or leave undetermined this statement? It would be unfortunate to lose information that shows past years' selling patterns.",
"choices": {
"0": "Entailment",
"1": "Neither entailed nor contradicted",
"2": "Contradiction"
}
}
Recorded model answers
| Model | Answer | Outcome |
|---|---|---|
| Astra | Entailment | Correct |
| Opus 5.5 | Entailment | Correct |
| GLiDE v1.2 | Entailment | Correct |
| Decider v1.1 | Entailment | Correct |
| Jev | Entailment | Correct |
| Microsoft Decision-1 | Entailment | Correct |
| Clef | Entailment | Correct |
| Luna Decisions | Entailment | Correct |
| Clef Flash | Entailment | Correct |
| Strands Decider | Entailment | Correct |
| GLiNER2.5 Decide | Neither entailed nor contradicted | Incorrect |
| Laya | Entailment | Correct |
| CalDec v1 | Entailment | Correct |
Source and sharing
Original MultiNLI pair: 72654e; OANC genre: oup. Transparent modification: selected excerpts and format normalization by Raindrop, 2026-11-09. Premise wording is unchanged. The original unmodified sentence pair is identified by pairID in the MultiNLI 1.0 release, available from the source URL. No source endorsement is implied.
Attribution: Adina Williams, Nikita Nangia, Samuel R. Bowman (MultiNLI); Oxford University Press book selections; Abernathy, Berk, Fletcher, Kauffman, Rybczinski; Copyright (c) 1999, 2001, 2003 Oxford University Press.
Terms: OANC (selected non-fiction genres). Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.
Exact source locator and input fingerprint
{
"source_locator": {
"path": "data/validation_mismatched-00000-of-00001.parquet",
"record": "2026",
"kind": "source_file_record"
},
"source_revision": "da70db2af9d09693783c3320c4249840212ee221",
"input_hash": "21787e36229e4c1545fef614b5a8a8f7e0a4e967c764dc720ef81d86da48f5d2"
}