RaindropA practical guide to choosing decision modelsGitHub ↗

Physical cognition · question 49

Back to Physical cognition · All capabilities

Question ID: newton/b34bb84ee9dde2eca1dc
Source: NEWTON
Input format: native choices

Explore this question’s altered versions

Recover the original question

No explicit dataset redistribution license was established for the selected source files. Obtain them from the publisher for local recovery; the README’s illustrative LICENSE entry is not a license grant.

Recover this question from its original source files. The recovery tool reconstructs the evaluated input and verifies its checksum.

Reference choice key: 1. Descriptions are withheld with the question text.

Recorded model answers

Model Answer Outcome
Astra 2 Incorrect
Opus 5.5 2 Incorrect
GLiDE v1.2 2 Incorrect
Decider v1.1 2 Incorrect
Jev 2 Incorrect
Microsoft Decision-1 2 Incorrect
Clef 2 Incorrect
Luna Decisions 2 Incorrect
Clef Flash 1 Correct
Strands Decider 1 Correct
GLiNER2.5 Decide 2 Incorrect
Laya 2 Incorrect
CalDec v1 2 Incorrect

Source and sharing

Attribution: NEWTON original creators; see source.
Terms: Not established. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.

Exact source locator and input fingerprint
{
  "source_locator": {
    "path": "confident_questions.csv",
    "record": "1970",
    "kind": "source_file_record"
  },
  "source_revision": "b55ed6d1ee3e1a1c3c142a5fe79df39319599626",
  "input_hash": "4195fd9298e390ed9bc5447a37472291caa60d2570e112989c7f490a6938629d"
}

Type to search questions, variants and documentation.