RaindropA practical guide to choosing decision modelsGitHub ↗

Information seeking · question 5

Back to Information seeking · All capabilities

Question ID: questbench/91b762f510be52b63eaf
Source: QuestBench (Google DeepMind)
Input format: native choices

Explore this question’s altered versions

Context

In a school, there are 29 pupils in a class and few number of pupils in another class. The teacher of the class with 29 pupils has 9 coupons, each coupon can be redeemed for 100 bottles of apple juice. The teacher of the other class has coupons, but she decided not to redeem them. The teacher with the 9 coupons gives each student in her class bottles of apple juice to drink for lunch, while the other teacher gives her students water. After redeeming all her coupons and giving each student their apple juice lunch, how many bottles of apple juice does the teacher of the class with 29 pupils have for herself?

Question

Which missing variable should be asked about to solve this problem?

Answer choices

  • F: Number of bottles of apple juice given to each student in the first class.
  • B: Number of pupils in the second class.
  • D: Number of coupons for the teacher with 15 pupils

Reference answer: Number of bottles of apple juice given to each student in the first class. (F)

Exact evaluated input as JSON
{
  "state": "In a school, there are 29 pupils in a class and few number of pupils in another class. The teacher of the class with 29 pupils has 9 coupons, each coupon can be redeemed for 100 bottles of apple juice. The teacher of the other class has coupons, but she decided not to redeem them. The teacher with the 9 coupons gives each student in her class bottles of apple juice to drink for lunch, while the other teacher gives her students water. After redeeming all her coupons and giving each student their apple juice lunch, how many bottles of apple juice does the teacher of the class with 29 pupils have for herself?",
  "question": "Which missing variable should be asked about to solve this problem?",
  "choices": {
    "F": "Number of bottles of apple juice given to each student in the first class.",
    "B": "Number of pupils in the second class.",
    "D": "Number of coupons for the teacher with 15 pupils"
  }
}

Recorded model answers

Model Answer Outcome
Astra Number of bottles of apple juice given to each student in the first class. Correct
Opus 5.5 Number of bottles of apple juice given to each student in the first class. Correct
GLiDE v1.2 Number of bottles of apple juice given to each student in the first class. Correct
Decider v1.1 Number of bottles of apple juice given to each student in the first class. Correct
Jev Number of bottles of apple juice given to each student in the first class. Correct
Microsoft Decision-1 Number of bottles of apple juice given to each student in the first class. Correct
Clef Number of bottles of apple juice given to each student in the first class. Correct
Luna Decisions Number of bottles of apple juice given to each student in the first class. Correct
Clef Flash Number of bottles of apple juice given to each student in the first class. Correct
Strands Decider Number of bottles of apple juice given to each student in the first class. Correct
GLiNER2.5 Decide Number of bottles of apple juice given to each student in the first class. Correct
Laya Number of coupons for the teacher with 15 pupils Incorrect
CalDec v1 Number of bottles of apple juice given to each student in the first class. Correct

Source and sharing

Attribution: Google LLC; QuestBench authors.
Terms: CC-BY-4.0. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.

Exact source locator and input fingerprint
{
  "source_locator": {
    "path": "extracted/questbench.tar.gz/questbench_data/GSM-Q/gsm_verbal_full.csv",
    "record": "10520",
    "kind": "source_file_record"
  },
  "source_revision": null,
  "input_hash": "3e4f424ccd7d27e924b7db4c75cf2cd0ea6435f40550fab8df15dadd62ae2eeb"
}

Type to search questions, variants and documentation.