RaindropA practical guide to choosing decision modelsGitHub ↗

Similar distractors · Add more similar but irrelevant items variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Read the full context

The essence of the task: for two given sentence episodes, choose a category that best describes the level of analogical similarity between them. The parent guided the child, compelling the child to follow the parent. <-> The teacher guided the student, compelling the student to follow the teacher. This is an example of literal similarity because the two episodes share all aspects of similarity. The parent guided the child, compelling the child to follow the parent. <-> The student followed the teacher, compelling the teacher to guide the student. This is an example of surface similarity because the two episodes share all aspects of similarity except higher-order structure. The parent guided the child, compelling the child to follow the parent. <-> The student ignored the teacher, compelling the teacher to reprimand the student. This is an example of only objects similarity because the two episodes only share object attribute similarity and higher-order relation similarity. The parent guided the child, compelling the child to follow the parent. <-> The Bible guided the worshippers, compelling the worshippers to follow the Bible. This is an example of an analogy because the two episodes share all aspects of similarity except role-filler binding similarity and object attribute similarity. The parent guided the child, compelling the child to follow the parent. <-> The minor guided the chaperone, compelling the chaperone to follow the minor. This is an example of a cross mapping because the two episodes share all aspects of similarity except role-filler binding similarity. The parent guided the child, compelling the child to follow the parent. <-> The Bible followed the worshippers, compelling the worshippers to guide the Bible. This is an example of a false analogy because the two episodes only share first-order relation similarity, higher-order relation similarity, and object-level isomorphism. The parent guided the child, compelling the child to follow the parent. <-> The cat swiped at the dog, and the dog barked at the cat. This is an example of no similarity because the two episodes share no aspects of similarity. The lion intimidated the zebra, causing the zebra to fear the lion. <-> The coyote intimidated the deer, causing the deer to fear the coyote. This is an example of literal similarity because the two episodes share all aspects of similarity. The lion intimidated the zebra, causing the zebra to fear the lion. <-> The coyote intimidated the deer, and the deer feared the coyote. This is an example of surface similarity because the two episodes share all aspects of similarity except higher-order relation similarity and higher-order structure similarity. The lion intimidated the zebra, causing the zebra to fear the lion. <-> The coyote pounced on the deer, but the deer escaped from the coyote. This is an example of only objects similarity because the two episodes share object attribute similarity. The lion intimidated the zebra, causing the zebra to fear the lion. <-> The mob intimidated the witness, causing the witness to fear the mob. This is an example of an analogy because the two episodes share all aspects of similarity except role-filler binding similarity and object attribute similarity. The lion intimidated the zebra, causing the zebra to fear the lion. <-> The mob feared the witness, causing the mob to intimidate the witness. This is an example of a false analogy because the two episodes only share first-order relation similarity, higher-order relation similarity, and higher-order structure similarity. The lion intimidated the zebra, causing the zebra to fear the lion. <-> The manager relied on the employee, and the employee assisted the manager. This is an example of no similarity because the two episodes share no aspects of similarity.

The coach praised the runner, causing the runner to thank the coach. <-> The director praised the actor, causing the actor to thank the director. The librarian answered the visitor, and the visitor thanked the librarian. <-> The visitor thanked the librarian, causing the librarian to answer the visitor. The tutor questioned the pupil, compelling the pupil to explain to the tutor. <-> The pupil questioned the tutor, compelling the tutor to explain to the pupil.

Question

The speech addressed the news anchor, causing the news anchor to respond to the speech. <-> The letter addressed the reporter, and the reporter responded to the letter. This is an example of

Answer choices

  • A. literal similarity.
  • B. an analogy.
  • C. a cross mapping.
  • D. surface similarity.
  • E. a false analogy.
  • F. only objects similarity.
  • G. no similarity.

Reference answer: D.

Exact evaluated input as JSON
{
  "state": "The essence of the task: for two given sentence episodes, choose a category that best describes the level of analogical similarity between them.\n  The parent guided the child, compelling the child to follow the parent. <-> The teacher guided the student, compelling the student to follow the teacher. This is an example of literal similarity because the two episodes share all aspects of similarity.\n  The parent guided the child, compelling the child to follow the parent. <-> The student followed the teacher, compelling the teacher to guide the student. This is an example of surface similarity because the two episodes share all aspects of similarity except higher-order structure.\n  The parent guided the child, compelling the child to follow the parent. <-> The student ignored the teacher, compelling the teacher to reprimand the student. This is an example of only objects similarity because the two episodes only share object attribute similarity and higher-order relation similarity.\n  The parent guided the child, compelling the child to follow the parent. <-> The Bible guided the worshippers, compelling the worshippers to follow the Bible. This is an example of an analogy because the two episodes share all aspects of similarity except role-filler binding similarity and object attribute similarity.\n  The parent guided the child, compelling the child to follow the parent. <-> The minor guided the chaperone, compelling the chaperone to follow the minor. This is an example of a cross mapping because the two episodes share all aspects of similarity except role-filler binding similarity.\n  The parent guided the child, compelling the child to follow the parent. <-> The Bible followed the worshippers, compelling the worshippers to guide the Bible. This is an example of a false analogy because the two episodes only share first-order relation similarity, higher-order relation similarity, and object-level isomorphism.\n  The parent guided the child, compelling the child to follow the parent. <-> The cat swiped at the dog, and the dog barked at the cat. This is an example of no similarity because the two episodes share no aspects of similarity.\n  The lion intimidated the zebra, causing the zebra to fear the lion. <-> The coyote intimidated the deer, causing the deer to fear the coyote. This is an example of literal similarity because the two episodes share all aspects of similarity.\n  The lion intimidated the zebra, causing the zebra to fear the lion. <-> The coyote intimidated the deer, and the deer feared the coyote. This is an example of surface similarity because the two episodes share all aspects of similarity except higher-order relation similarity and higher-order structure similarity.\n  The lion intimidated the zebra, causing the zebra to fear the lion. <-> The coyote pounced on the deer, but the deer escaped from the coyote. This is an example of only objects similarity because the two episodes share object attribute similarity.\n  The lion intimidated the zebra, causing the zebra to fear the lion. <-> The mob intimidated the witness, causing the witness to fear the mob. This is an example of an analogy because the two episodes share all aspects of similarity except role-filler binding similarity and object attribute similarity.\n  The lion intimidated the zebra, causing the zebra to fear the lion. <-> The mob feared the witness, causing the mob to intimidate the witness. This is an example of a false analogy because the two episodes only share first-order relation similarity, higher-order relation similarity, and higher-order structure similarity.\n  The lion intimidated the zebra, causing the zebra to fear the lion. <-> The manager relied on the employee, and the employee assisted the manager. This is an example of no similarity because the two episodes share no aspects of similarity.\n\n  The coach praised the runner, causing the runner to thank the coach. <-> The director praised the actor, causing the actor to thank the director.\n  The librarian answered the visitor, and the visitor thanked the librarian. <-> The visitor thanked the librarian, causing the librarian to answer the visitor.\n  The tutor questioned the pupil, compelling the pupil to explain to the tutor. <-> The pupil questioned the tutor, compelling the tutor to explain to the pupil.",
  "question": "The speech addressed the news anchor, causing the news anchor to respond to the speech. <-> The letter addressed the reporter, and the reporter responded to the letter. This is an example of ",
  "choices": {
    "A": "literal similarity.",
    "B": "an analogy.",
    "C": "a cross mapping.",
    "D": "surface similarity.",
    "E": "a false analogy.",
    "F": "only objects similarity.",
    "G": "no similarity."
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 D — surface similarity. D — surface similarity. Same answer
Decider v1.1 D — surface similarity. D — surface similarity. Same answer
Jev A — literal similarity. A — literal similarity. Same answer
Microsoft Decision-1 A — literal similarity. A — literal similarity. Same answer
Clef D — surface similarity. D — surface similarity. Same answer
Luna Decisions D — surface similarity. D — surface similarity. Same answer
Clef Flash A — literal similarity. A — literal similarity. Same answer
Strands Decider B — an analogy. C — a cross mapping. Different answer
GLiNER2.5 Decide E — a false analogy. E — a false analogy. Same answer
Laya B — an analogy. A — literal similarity. Different answer
CalDec v1 D — surface similarity. B — an analogy. Different answer
Identifiers and recorded conditions

Variant ID: analogical_similarity/253cfd6410029979b6f8/similar_distractors/high/clean-source_first_analogy_missing_factors_full_0160

Input fingerprint: 34ddb9e78952a6efdc6f87a6c9b6d6a00a1b6abddb030047fb9ec2adfaf880a3

Change Recorded version
Similar distractors Add more similar but irrelevant items

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.