Concepts and categorization · question 26
Back to Concepts and categorization · All capabilities
Question ID: banking77/96514c17ff090c228060
Source: Banking77
Input format: native choices
Explore this question’s altered versions
Context
How do I make contactless work
Question
Which banking intent does this request express?
Answer choices
- 0: activate_my_card
- 1: age_limit
- 2: apple_pay_or_google_pay
- 3: atm_support
- 4: automatic_top_up
- 5: balance_not_updated_after_bank_transfer
- 6: balance_not_updated_after_cheque_or_cash_deposit
- 7: beneficiary_not_allowed
- 8: cancel_transfer
- 9: card_about_to_expire
- 10: card_acceptance
- 11: card_arrival
- 12: card_delivery_estimate
- 13: card_linking
- 14: card_not_working
- 15: card_payment_fee_charged
- 16: card_payment_not_recognised
- 17: card_payment_wrong_exchange_rate
- 18: card_swallowed
- 19: cash_withdrawal_charge
- 20: cash_withdrawal_not_recognised
- 21: change_pin
- 22: compromised_card
- 23: contactless_not_working
- 24: country_support
- 25: declined_card_payment
- 26: declined_cash_withdrawal
- 27: declined_transfer
- 28: direct_debit_payment_not_recognised
- 29: disposable_card_limits
- 30: edit_personal_details
- 31: exchange_charge
- 32: exchange_rate
- 33: exchange_via_app
- 34: extra_charge_on_statement
- 35: failed_transfer
- 36: fiat_currency_support
- 37: get_disposable_virtual_card
- 38: get_physical_card
- 39: getting_spare_card
- 40: getting_virtual_card
- 41: lost_or_stolen_card
- 42: lost_or_stolen_phone
- 43: order_physical_card
- 44: passcode_forgotten
- 45: pending_card_payment
- 46: pending_cash_withdrawal
- 47: pending_top_up
- 48: pending_transfer
- 49: pin_blocked
- 50: receiving_money
- 51: Refund_not_showing_up
- 52: request_refund
- 53: reverted_card_payment?
- 54: supported_cards_and_currencies
- 55: terminate_account
- 56: top_up_by_bank_transfer_charge
- 57: top_up_by_card_charge
- 58: top_up_by_cash_or_cheque
- 59: top_up_failed
- 60: top_up_limits
- 61: top_up_reverted
- 62: topping_up_by_card
- 63: transaction_charged_twice
- 64: transfer_fee_charged
- 65: transfer_into_account
- 66: transfer_not_received_by_recipient
- 67: transfer_timing
- 68: unable_to_verify_identity
- 69: verify_my_identity
- 70: verify_source_of_funds
- 71: verify_top_up
- 72: virtual_card_not_working
- 73: visa_or_mastercard
- 74: why_verify_identity
- 75: wrong_amount_of_cash_received
- 76: wrong_exchange_rate_for_cash_withdrawal
Reference answer: contactless_not_working (23)
Exact evaluated input as JSON
{
"state": "How do I make contactless work",
"question": "Which banking intent does this request express?",
"choices": {
"0": "activate_my_card",
"1": "age_limit",
"2": "apple_pay_or_google_pay",
"3": "atm_support",
"4": "automatic_top_up",
"5": "balance_not_updated_after_bank_transfer",
"6": "balance_not_updated_after_cheque_or_cash_deposit",
"7": "beneficiary_not_allowed",
"8": "cancel_transfer",
"9": "card_about_to_expire",
"10": "card_acceptance",
"11": "card_arrival",
"12": "card_delivery_estimate",
"13": "card_linking",
"14": "card_not_working",
"15": "card_payment_fee_charged",
"16": "card_payment_not_recognised",
"17": "card_payment_wrong_exchange_rate",
"18": "card_swallowed",
"19": "cash_withdrawal_charge",
"20": "cash_withdrawal_not_recognised",
"21": "change_pin",
"22": "compromised_card",
"23": "contactless_not_working",
"24": "country_support",
"25": "declined_card_payment",
"26": "declined_cash_withdrawal",
"27": "declined_transfer",
"28": "direct_debit_payment_not_recognised",
"29": "disposable_card_limits",
"30": "edit_personal_details",
"31": "exchange_charge",
"32": "exchange_rate",
"33": "exchange_via_app",
"34": "extra_charge_on_statement",
"35": "failed_transfer",
"36": "fiat_currency_support",
"37": "get_disposable_virtual_card",
"38": "get_physical_card",
"39": "getting_spare_card",
"40": "getting_virtual_card",
"41": "lost_or_stolen_card",
"42": "lost_or_stolen_phone",
"43": "order_physical_card",
"44": "passcode_forgotten",
"45": "pending_card_payment",
"46": "pending_cash_withdrawal",
"47": "pending_top_up",
"48": "pending_transfer",
"49": "pin_blocked",
"50": "receiving_money",
"51": "Refund_not_showing_up",
"52": "request_refund",
"53": "reverted_card_payment?",
"54": "supported_cards_and_currencies",
"55": "terminate_account",
"56": "top_up_by_bank_transfer_charge",
"57": "top_up_by_card_charge",
"58": "top_up_by_cash_or_cheque",
"59": "top_up_failed",
"60": "top_up_limits",
"61": "top_up_reverted",
"62": "topping_up_by_card",
"63": "transaction_charged_twice",
"64": "transfer_fee_charged",
"65": "transfer_into_account",
"66": "transfer_not_received_by_recipient",
"67": "transfer_timing",
"68": "unable_to_verify_identity",
"69": "verify_my_identity",
"70": "verify_source_of_funds",
"71": "verify_top_up",
"72": "virtual_card_not_working",
"73": "visa_or_mastercard",
"74": "why_verify_identity",
"75": "wrong_amount_of_cash_received",
"76": "wrong_exchange_rate_for_cash_withdrawal"
}
}
Recorded model answers
| Model | Answer | Outcome |
|---|---|---|
| Astra | contactless_not_working | Correct |
| Opus 5.5 | contactless_not_working | Correct |
| GLiDE v1.2 | contactless_not_working | Correct |
| Decider v1.1 | contactless_not_working | Correct |
| Jev | contactless_not_working | Correct |
| Microsoft Decision-1 | contactless_not_working | Correct |
| Clef | contactless_not_working | Correct |
| Luna Decisions | contactless_not_working | Correct |
| Clef Flash | contactless_not_working | Correct |
| Strands Decider | contactless_not_working | Correct |
| GLiNER2.5 Decide | contactless_not_working | Correct |
| Laya | declined_card_payment | Incorrect |
| CalDec v1 | top_up_by_bank_transfer_charge | Incorrect |
Source and sharing
Attribution: PolyAI; Iñigo Casanueva et al..
Terms: CC-BY-4.0. Source sharing decision.
The capability assignment and choice-format normalization are part of this experiment. Source data retain their own terms.
Exact source locator and input fingerprint
{
"source_locator": {
"path": "data/test-00000-of-00001.parquet",
"record": "585",
"kind": "source_file_record"
},
"source_revision": "1846984189f2bc0ac51c6fc3a600fa9e1714e0c6",
"input_hash": "9bae2d3fa3e9061c2c4452bab4296c6190b2394ff755ea51bd2bdd13c4cdfa16"
}