Social cognition · question 64
Back to Social cognition · All capabilities
Question ID: socialiqa/d984d48b0434702125f9
Source: Social IQa
Input format: native choices
Explore this question’s altered versions
Context
Carson sees Cameron crying over what someone said. Carson tells Cameron not to worry that they are very pretty and beautiful.
Question
Why did Carson do this?
Answer choices
- A: help Cameron's self esteem
- B: bad
- C: hurt Cameron's feelings
Reference answer: help Cameron's self esteem (A)
Exact evaluated input as JSON
{
"state": "Carson sees Cameron crying over what someone said. Carson tells Cameron not to worry that they are very pretty and beautiful.",
"question": "Why did Carson do this?",
"choices": {
"A": "help Cameron's self esteem",
"B": "bad",
"C": "hurt Cameron's feelings"
}
}
Recorded model answers
| Model | Answer | Outcome |
|---|---|---|
| Astra | help Cameron's self esteem | Correct |
| Opus 5.5 | help Cameron's self esteem | Correct |
| GLiDE v1.2 | help Cameron's self esteem | Correct |
| Decider v1.1 | help Cameron's self esteem | Correct |
| Jev | help Cameron's self esteem | Correct |
| Microsoft Decision-1 | help Cameron's self esteem | Correct |
| Clef | help Cameron's self esteem | Correct |
| Luna Decisions | help Cameron's self esteem | Correct |
| Clef Flash | help Cameron's self esteem | Correct |
| Strands Decider | help Cameron's self esteem | Correct |
| GLiNER2.5 Decide | help Cameron's self esteem | Correct |
| Laya | help Cameron's self esteem | Correct |
| CalDec v1 | help Cameron's self esteem | Correct |
Source and sharing
Attribution: Maarten Sap, Hannah Rashkin, Derek Chen, Ronan LeBras, Yejin Choi.
Terms: CC-BY-4.0. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.
Exact source locator and input fingerprint
{
"source_locator": {
"path": "extracted/socialiqa.zip/socialiqa-train-dev/train.jsonl",
"record": "15884",
"kind": "source_file_record"
},
"source_revision": null,
"input_hash": "26eec177f53fd73237ba0996173a7d1d774534453434070802c8959a271b2ed6"
}