RaindropA practical guide to choosing decision modelsGitHub ↗

Physical cognition · question 6

Back to Physical cognition · All capabilities

Question ID: mmlu/58bca2a8dce053dc5c6b
Source: MMLU
Input format: native choices

Explore this question’s altered versions

Question

A simple and correct way to comprehend satellites orbiting Earth is to view them as

Answer choices

  • A: balanced between gravitational and centripetal forces.
  • B: beyond the main pull of Earth gravity.
  • C: in mechanical equilibrium with a net force of zero.
  • D: having sufficient tangential velocities to fall around rather than into Earth.

Reference answer: having sufficient tangential velocities to fall around rather than into Earth. (D)

Exact evaluated input as JSON
{
  "state": "",
  "question": "A simple and correct way to comprehend satellites orbiting Earth is to view them as",
  "choices": {
    "A": "balanced between gravitational and centripetal forces.",
    "B": "beyond the main pull of Earth gravity.",
    "C": "in mechanical equilibrium with a net force of zero.",
    "D": "having sufficient tangential velocities to fall around rather than into Earth."
  }
}

Recorded model answers

Model Answer Outcome
Astra having sufficient tangential velocities to fall around rather than into Earth. Correct
Opus 5.5 having sufficient tangential velocities to fall around rather than into Earth. Correct
GLiDE v1.2 having sufficient tangential velocities to fall around rather than into Earth. Correct
Decider v1.1 having sufficient tangential velocities to fall around rather than into Earth. Correct
Jev having sufficient tangential velocities to fall around rather than into Earth. Correct
Microsoft Decision-1 having sufficient tangential velocities to fall around rather than into Earth. Correct
Clef having sufficient tangential velocities to fall around rather than into Earth. Correct
Luna Decisions having sufficient tangential velocities to fall around rather than into Earth. Correct
Clef Flash having sufficient tangential velocities to fall around rather than into Earth. Correct
Strands Decider having sufficient tangential velocities to fall around rather than into Earth. Correct
GLiNER2.5 Decide having sufficient tangential velocities to fall around rather than into Earth. Correct
Laya in mechanical equilibrium with a net force of zero. Incorrect
CalDec v1 balanced between gravitational and centripetal forces. Incorrect

Source and sharing

Attribution: Dan Hendrycks et al.; MMLU authors.
Terms: MIT. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.

Exact source locator and input fingerprint
{
  "source_locator": {
    "path": "all/test-00000-of-00001.parquet",
    "record": "1805",
    "kind": "source_file_record"
  },
  "source_revision": "c30699e8356da336a370243923dbaf21066bb9fe",
  "input_hash": "f9efad938a0f56c65c12c6a2d50ec89a5db8dc3e3bdd9c255675d7c212fadfe6"
}

Type to search questions, variants and documentation.