RaindropA practical guide to choosing decision modelsGitHub ↗

Retrieval · question 13

Back to Retrieval · All capabilities

Question ID: boolq/387304ce1c4c16729c75
Source: BoolQ
Input format: native choices

Explore this question’s altered versions

Context

Administrative leave is a temporary leave from a job assignment, with pay and benefits intact. Generally, the term is reserved for employees of non-business institutions such as schools, police, and hospitals.

Question

do you get paid when on administrative leave

Answer choices

  • yes: Yes
  • no: No

Reference answer: Yes (yes)

Exact evaluated input as JSON
{
  "state": "Administrative leave is a temporary leave from a job assignment, with pay and benefits intact. Generally, the term is reserved for employees of non-business institutions such as schools, police, and hospitals.",
  "question": "do you get paid when on administrative leave",
  "choices": {
    "yes": "Yes",
    "no": "No"
  }
}

Recorded model answers

Model Answer Outcome
Astra Yes Correct
Opus 5.5 Yes Correct
GLiDE v1.2 Yes Correct
Decider v1.1 Yes Correct
Jev Yes Correct
Microsoft Decision-1 Yes Correct
Clef Yes Correct
Luna Decisions Yes Correct
Clef Flash Yes Correct
Strands Decider Yes Correct
GLiNER2.5 Decide Yes Correct
Laya Yes Correct
CalDec v1 Yes Correct

Source and sharing

Original Wikipedia passage: Administrative leave; contributor history. The BoolQ excerpt is unchanged. This question material retains CC BY-SA 3.0.

Attribution: Wikipedia contributors; Christopher Clark, Kenton Lee, Ming-Wei Chang, Tom Kwiatkowski, Michael Collins, Kristina Toutanova (BoolQ).
Terms: CC-BY-SA-3.0. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.

Exact source locator and input fingerprint
{
  "source_locator": {
    "path": "data/validation-00000-of-00001.parquet",
    "record": "2344",
    "kind": "source_file_record"
  },
  "source_revision": "35b264d03638db9f4ce671b711558bf7ff0f80d5",
  "input_hash": "5e914ae9682105c7cc908a3d2b0b9c7274235a4091ba669b577a2214a7866b24"
}

Type to search questions, variants and documentation.