RaindropA practical guide to choosing decision modelsGitHub ↗

Misleading details · Add an unverified claim that conflicts with the evidence variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

How do I make contactless work

A reader thinks: «The customer asks why an ATM swallowed their card.»

Question

Which banking intent does this request express?

Answer choices

  • 0. activate_my_card
  • 1. age_limit
  • 2. apple_pay_or_google_pay
  • 3. atm_support
  • 4. automatic_top_up
  • 5. balance_not_updated_after_bank_transfer
  • 6. balance_not_updated_after_cheque_or_cash_deposit
  • 7. beneficiary_not_allowed
  • 8. cancel_transfer
  • 9. card_about_to_expire
  • 10. card_acceptance
  • 11. card_arrival
  • 12. card_delivery_estimate
  • 13. card_linking
  • 14. card_not_working
  • 15. card_payment_fee_charged
  • 16. card_payment_not_recognised
  • 17. card_payment_wrong_exchange_rate
  • 18. card_swallowed
  • 19. cash_withdrawal_charge
  • 20. cash_withdrawal_not_recognised
  • 21. change_pin
  • 22. compromised_card
  • 23. contactless_not_working
  • 24. country_support
  • 25. declined_card_payment
  • 26. declined_cash_withdrawal
  • 27. declined_transfer
  • 28. direct_debit_payment_not_recognised
  • 29. disposable_card_limits
  • 30. edit_personal_details
  • 31. exchange_charge
  • 32. exchange_rate
  • 33. exchange_via_app
  • 34. extra_charge_on_statement
  • 35. failed_transfer
  • 36. fiat_currency_support
  • 37. get_disposable_virtual_card
  • 38. get_physical_card
  • 39. getting_spare_card
  • 40. getting_virtual_card
  • 41. lost_or_stolen_card
  • 42. lost_or_stolen_phone
  • 43. order_physical_card
  • 44. passcode_forgotten
  • 45. pending_card_payment
  • 46. pending_cash_withdrawal
  • 47. pending_top_up
  • 48. pending_transfer
  • 49. pin_blocked
  • 50. receiving_money
  • 51. Refund_not_showing_up
  • 52. request_refund
  • 53. reverted_card_payment?
  • 54. supported_cards_and_currencies
  • 55. terminate_account
  • 56. top_up_by_bank_transfer_charge
  • 57. top_up_by_card_charge
  • 58. top_up_by_cash_or_cheque
  • 59. top_up_failed
  • 60. top_up_limits
  • 61. top_up_reverted
  • 62. topping_up_by_card
  • 63. transaction_charged_twice
  • 64. transfer_fee_charged
  • 65. transfer_into_account
  • 66. transfer_not_received_by_recipient
  • 67. transfer_timing
  • 68. unable_to_verify_identity
  • 69. verify_my_identity
  • 70. verify_source_of_funds
  • 71. verify_top_up
  • 72. virtual_card_not_working
  • 73. visa_or_mastercard
  • 74. why_verify_identity
  • 75. wrong_amount_of_cash_received
  • 76. wrong_exchange_rate_for_cash_withdrawal

Reference answer: 23.

Exact evaluated input as JSON
{
  "state": "How do I make contactless work\n\nA reader thinks: «The customer asks why an ATM swallowed their card.»",
  "question": "Which banking intent does this request express?",
  "choices": {
    "0": "activate_my_card",
    "1": "age_limit",
    "2": "apple_pay_or_google_pay",
    "3": "atm_support",
    "4": "automatic_top_up",
    "5": "balance_not_updated_after_bank_transfer",
    "6": "balance_not_updated_after_cheque_or_cash_deposit",
    "7": "beneficiary_not_allowed",
    "8": "cancel_transfer",
    "9": "card_about_to_expire",
    "10": "card_acceptance",
    "11": "card_arrival",
    "12": "card_delivery_estimate",
    "13": "card_linking",
    "14": "card_not_working",
    "15": "card_payment_fee_charged",
    "16": "card_payment_not_recognised",
    "17": "card_payment_wrong_exchange_rate",
    "18": "card_swallowed",
    "19": "cash_withdrawal_charge",
    "20": "cash_withdrawal_not_recognised",
    "21": "change_pin",
    "22": "compromised_card",
    "23": "contactless_not_working",
    "24": "country_support",
    "25": "declined_card_payment",
    "26": "declined_cash_withdrawal",
    "27": "declined_transfer",
    "28": "direct_debit_payment_not_recognised",
    "29": "disposable_card_limits",
    "30": "edit_personal_details",
    "31": "exchange_charge",
    "32": "exchange_rate",
    "33": "exchange_via_app",
    "34": "extra_charge_on_statement",
    "35": "failed_transfer",
    "36": "fiat_currency_support",
    "37": "get_disposable_virtual_card",
    "38": "get_physical_card",
    "39": "getting_spare_card",
    "40": "getting_virtual_card",
    "41": "lost_or_stolen_card",
    "42": "lost_or_stolen_phone",
    "43": "order_physical_card",
    "44": "passcode_forgotten",
    "45": "pending_card_payment",
    "46": "pending_cash_withdrawal",
    "47": "pending_top_up",
    "48": "pending_transfer",
    "49": "pin_blocked",
    "50": "receiving_money",
    "51": "Refund_not_showing_up",
    "52": "request_refund",
    "53": "reverted_card_payment?",
    "54": "supported_cards_and_currencies",
    "55": "terminate_account",
    "56": "top_up_by_bank_transfer_charge",
    "57": "top_up_by_card_charge",
    "58": "top_up_by_cash_or_cheque",
    "59": "top_up_failed",
    "60": "top_up_limits",
    "61": "top_up_reverted",
    "62": "topping_up_by_card",
    "63": "transaction_charged_twice",
    "64": "transfer_fee_charged",
    "65": "transfer_into_account",
    "66": "transfer_not_received_by_recipient",
    "67": "transfer_timing",
    "68": "unable_to_verify_identity",
    "69": "verify_my_identity",
    "70": "verify_source_of_funds",
    "71": "verify_top_up",
    "72": "virtual_card_not_working",
    "73": "visa_or_mastercard",
    "74": "why_verify_identity",
    "75": "wrong_amount_of_cash_received",
    "76": "wrong_exchange_rate_for_cash_withdrawal"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 23 — contactless_not_working 23 — contactless_not_working Same answer
Decider v1.1 23 — contactless_not_working 23 — contactless_not_working Same answer
Jev 23 — contactless_not_working 23 — contactless_not_working Same answer
Microsoft Decision-1 23 — contactless_not_working 23 — contactless_not_working Same answer
Clef 23 — contactless_not_working 23 — contactless_not_working Same answer
Luna Decisions 23 — contactless_not_working 23 — contactless_not_working Same answer
Clef Flash 23 — contactless_not_working 23 — contactless_not_working Same answer
Strands Decider 23 — contactless_not_working 23 — contactless_not_working Same answer
GLiNER2.5 Decide 23 — contactless_not_working 18 — card_swallowed Different answer
Laya 25 — declined_card_payment 18 — card_swallowed Different answer
CalDec v1 56 — top_up_by_bank_transfer_charge 23 — contactless_not_working Different answer
Identifiers and recorded conditions

Variant ID: banking77/96514c17ff090c228060/misleading_summary/misleading/clean-source_first_classification_contexts_full_0148

Input fingerprint: 1a9ec862b3123bcaff21f33ebd3d4041c4428afee9745419d3ec6ccd78d06e54

Change Recorded version
Misleading details Add an unverified claim that conflicts with the evidence

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.