Irrelevant details · Add a larger amount of irrelevant detail variant
Original question · Other versions of this question · All variants
This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.
Changed fields: context.
How the edits were constructed
Context
Kofi is a chef at a popular Ghanaian restaurant. Kofi wants to prepare a traditional groundnut soup for the dinner menu. Kofi adds a small container of peanut butter to the soup pot on the stove. Kofi believes the soup contains peanut butter. An apprentice chef, mistakenly thinking it was a seasoning paste, removes the peanut butter from the soup and replaces it with tomato paste. Kofi does not notice the apprentice chef swapping the ingredients.
The musical suite Merovan includes a refrain. Merovan uses a tonic cadence. Merovan includes rests. Merovan has sustained harmonies. Merovan has detached melodic notes. Merovan varies its accompaniment.
Question
Does Kofi believe the soup contains peanut butter or tomato paste?
Answer choices
- A. Kofi believes the soup contains tomato paste.
- B. Kofi believes the soup contains peanut butter.
Reference answer: B.
Exact evaluated input as JSON
{
"state": "Kofi is a chef at a popular Ghanaian restaurant. Kofi wants to prepare a traditional groundnut soup for the dinner menu. Kofi adds a small container of peanut butter to the soup pot on the stove. Kofi believes the soup contains peanut butter. An apprentice chef, mistakenly thinking it was a seasoning paste, removes the peanut butter from the soup and replaces it with tomato paste. Kofi does not notice the apprentice chef swapping the ingredients.\n\nThe musical suite Merovan includes a refrain. Merovan uses a tonic cadence. Merovan includes rests. Merovan has sustained harmonies. Merovan has detached melodic notes. Merovan varies its accompaniment.",
"question": "Does Kofi believe the soup contains peanut butter or tomato paste?",
"choices": {
"A": "Kofi believes the soup contains tomato paste.",
"B": "Kofi believes the soup contains peanut butter."
}
}
Recorded model answers
The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.
| Model | Original answer | Variant answer | Change |
|---|---|---|---|
| GLiDE v1.2 | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| Decider v1.1 | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| Jev | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| Microsoft Decision-1 | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| Clef | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| Luna Decisions | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| Clef Flash | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| Strands Decider | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| GLiNER2.5 Decide | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| Laya | B — Kofi believes the soup contains peanut butter. |
B — Kofi believes the soup contains peanut butter. |
Same answer |
| CalDec v1 | A — Kofi believes the soup contains tomato paste. |
B — Kofi believes the soup contains peanut butter. |
Different answer |
Identifiers and recorded conditions
Variant ID: bigtom/466418e603869271f89a/irrelevant_details/high/clean-source_first_belief_toxicity_contexts_full_0150
Input fingerprint: 68ef88ce13c2d4d98b7a1eb0bda42ff57bed701927082a36b40e275eca2233ce
| Change | Recorded version |
|---|---|
| Irrelevant details | Add a larger amount of irrelevant detail |
Source attribution and dataset terms are linked from the original question.