RaindropA practical guide to choosing decision modelsGitHub ↗

Retrieval · question 5

Back to Retrieval · All capabilities

Question ID: mmlu/60d73e36893ac920148b
Source: MMLU
Input format: native choices

Explore this question’s altered versions

Question

When customers assess prices, they estimate value using __________, because they do not always know the true cost and price of the item that they are purchasing. These pricing cues include: sale signs; odd-number pricing; the purchase context; and price bundling and rebates.

Answer choices

  • A: Pricing strategies.
  • B: Sale price.
  • C: Pricing cues.
  • D: Pricing bundles.

Reference answer: Pricing cues. (C)

Exact evaluated input as JSON
{
  "state": "",
  "question": " When customers assess prices, they estimate value using __________, because they do not always know the true cost and price of the item that they are purchasing. These pricing cues include: sale signs; odd-number pricing; the purchase context; and price bundling and rebates.",
  "choices": {
    "A": "Pricing strategies.",
    "B": "Sale price.",
    "C": "Pricing cues.",
    "D": "Pricing bundles."
  }
}

Recorded model answers

Model Answer Outcome
Astra Pricing cues. Correct
Opus 5.5 Pricing cues. Correct
GLiDE v1.2 Pricing cues. Correct
Decider v1.1 Pricing cues. Correct
Jev Pricing cues. Correct
Microsoft Decision-1 Pricing cues. Correct
Clef Pricing cues. Correct
Luna Decisions Pricing cues. Correct
Clef Flash Pricing cues. Correct
Strands Decider Pricing cues. Correct
GLiNER2.5 Decide Pricing cues. Correct
Laya Pricing cues. Correct
CalDec v1 Pricing cues. Correct

Source and sharing

Attribution: Dan Hendrycks et al.; MMLU authors.
Terms: MIT. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.

Exact source locator and input fingerprint
{
  "source_locator": {
    "path": "all/validation-00000-of-00001.parquet",
    "record": "770",
    "kind": "source_file_record"
  },
  "source_revision": "c30699e8356da336a370243923dbaf21066bb9fe",
  "input_hash": "4c791b6022e9634fa86480d8f0899ccfb732532a8fe47e6446b90f88e81c22ac"
}

Type to search questions, variants and documentation.