RaindropA practical guide to choosing decision modelsGitHub ↗

Irrelevant details · Add a small amount of irrelevant detail variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

what type of plug do i need to bring if i visit japan

The musical suite Merovan includes a refrain.

Question

Which intent does this request express?

Answer choices

  • accept_reservations. accept reservations
  • account_blocked. account blocked
  • alarm. alarm
  • application_status. application status
  • apr. apr
  • are_you_a_bot. are you a bot
  • balance. balance
  • bill_balance. bill balance
  • bill_due. bill due
  • book_flight. book flight
  • book_hotel. book hotel
  • calculator. calculator
  • calendar. calendar
  • calendar_update. calendar update
  • calories. calories
  • cancel. cancel
  • cancel_reservation. cancel reservation
  • car_rental. car rental
  • card_declined. card declined
  • carry_on. carry on
  • change_accent. change accent
  • change_ai_name. change ai name
  • change_language. change language
  • change_speed. change speed
  • change_user_name. change user name
  • change_volume. change volume
  • confirm_reservation. confirm reservation
  • cook_time. cook time
  • credit_limit. credit limit
  • credit_limit_change. credit limit change
  • credit_score. credit score
  • current_location. current location
  • damaged_card. damaged card
  • date. date
  • definition. definition
  • direct_deposit. direct deposit
  • directions. directions
  • distance. distance
  • do_you_have_pets. do you have pets
  • exchange_rate. exchange rate
  • expiration_date. expiration date
  • find_phone. find phone
  • flight_status. flight status
  • flip_coin. flip coin
  • food_last. food last
  • freeze_account. freeze account
  • fun_fact. fun fact
  • gas. gas
  • gas_type. gas type
  • goodbye. goodbye
  • greeting. greeting
  • how_busy. how busy
  • how_old_are_you. how old are you
  • improve_credit_score. improve credit score
  • income. income
  • ingredient_substitution. ingredient substitution
  • ingredients_list. ingredients list
  • insurance. insurance
  • insurance_change. insurance change
  • interest_rate. interest rate
  • international_fees. international fees
  • international_visa. international visa
  • jump_start. jump start
  • last_maintenance. last maintenance
  • lost_luggage. lost luggage
  • make_call. make call
  • maybe. maybe
  • meal_suggestion. meal suggestion
  • meaning_of_life. meaning of life
  • measurement_conversion. measurement conversion
  • meeting_schedule. meeting schedule
  • min_payment. min payment
  • mpg. mpg
  • new_card. new card
  • next_holiday. next holiday
  • next_song. next song
  • no. no
  • nutrition_info. nutrition info
  • oil_change_how. oil change how
  • oil_change_when. oil change when
  • oos. oos
  • order. order
  • order_checks. order checks
  • order_status. order status
  • pay_bill. pay bill
  • payday. payday
  • pin_change. pin change
  • play_music. play music
  • plug_type. plug type
  • pto_balance. pto balance
  • pto_request. pto request
  • pto_request_status. pto request status
  • pto_used. pto used
  • recipe. recipe
  • redeem_rewards. redeem rewards
  • reminder. reminder
  • reminder_update. reminder update
  • repeat. repeat
  • replacement_card_duration. replacement card duration
  • report_fraud. report fraud
  • report_lost_card. report lost card
  • reset_settings. reset settings
  • restaurant_reservation. restaurant reservation
  • restaurant_reviews. restaurant reviews
  • restaurant_suggestion. restaurant suggestion
  • rewards_balance. rewards balance
  • roll_dice. roll dice
  • rollover_401k. rollover 401k
  • routing. routing
  • schedule_maintenance. schedule maintenance
  • schedule_meeting. schedule meeting
  • share_location. share location
  • shopping_list. shopping list
  • shopping_list_update. shopping list update
  • smart_home. smart home
  • spelling. spelling
  • spending_history. spending history
  • sync_device. sync device
  • taxes. taxes
  • tell_joke. tell joke
  • text. text
  • thank_you. thank you
  • time. time
  • timer. timer
  • timezone. timezone
  • tire_change. tire change
  • tire_pressure. tire pressure
  • todo_list. todo list
  • todo_list_update. todo list update
  • traffic. traffic
  • transactions. transactions
  • transfer. transfer
  • translate. translate
  • travel_alert. travel alert
  • travel_notification. travel notification
  • travel_suggestion. travel suggestion
  • uber. uber
  • update_playlist. update playlist
  • user_name. user name
  • vaccines. vaccines
  • w2. w2
  • weather. weather
  • what_are_your_hobbies. what are your hobbies
  • what_can_i_ask_you. what can i ask you
  • what_is_your_name. what is your name
  • what_song. what song
  • where_are_you_from. where are you from
  • whisper_mode. whisper mode
  • who_do_you_work_for. who do you work for
  • who_made_you. who made you
  • yes. yes

Reference answer: plug_type.

Exact evaluated input as JSON
{
  "state": "what type of plug do i need to bring if i visit japan\n\nThe musical suite Merovan includes a refrain.",
  "question": "Which intent does this request express?",
  "choices": {
    "accept_reservations": "accept reservations",
    "account_blocked": "account blocked",
    "alarm": "alarm",
    "application_status": "application status",
    "apr": "apr",
    "are_you_a_bot": "are you a bot",
    "balance": "balance",
    "bill_balance": "bill balance",
    "bill_due": "bill due",
    "book_flight": "book flight",
    "book_hotel": "book hotel",
    "calculator": "calculator",
    "calendar": "calendar",
    "calendar_update": "calendar update",
    "calories": "calories",
    "cancel": "cancel",
    "cancel_reservation": "cancel reservation",
    "car_rental": "car rental",
    "card_declined": "card declined",
    "carry_on": "carry on",
    "change_accent": "change accent",
    "change_ai_name": "change ai name",
    "change_language": "change language",
    "change_speed": "change speed",
    "change_user_name": "change user name",
    "change_volume": "change volume",
    "confirm_reservation": "confirm reservation",
    "cook_time": "cook time",
    "credit_limit": "credit limit",
    "credit_limit_change": "credit limit change",
    "credit_score": "credit score",
    "current_location": "current location",
    "damaged_card": "damaged card",
    "date": "date",
    "definition": "definition",
    "direct_deposit": "direct deposit",
    "directions": "directions",
    "distance": "distance",
    "do_you_have_pets": "do you have pets",
    "exchange_rate": "exchange rate",
    "expiration_date": "expiration date",
    "find_phone": "find phone",
    "flight_status": "flight status",
    "flip_coin": "flip coin",
    "food_last": "food last",
    "freeze_account": "freeze account",
    "fun_fact": "fun fact",
    "gas": "gas",
    "gas_type": "gas type",
    "goodbye": "goodbye",
    "greeting": "greeting",
    "how_busy": "how busy",
    "how_old_are_you": "how old are you",
    "improve_credit_score": "improve credit score",
    "income": "income",
    "ingredient_substitution": "ingredient substitution",
    "ingredients_list": "ingredients list",
    "insurance": "insurance",
    "insurance_change": "insurance change",
    "interest_rate": "interest rate",
    "international_fees": "international fees",
    "international_visa": "international visa",
    "jump_start": "jump start",
    "last_maintenance": "last maintenance",
    "lost_luggage": "lost luggage",
    "make_call": "make call",
    "maybe": "maybe",
    "meal_suggestion": "meal suggestion",
    "meaning_of_life": "meaning of life",
    "measurement_conversion": "measurement conversion",
    "meeting_schedule": "meeting schedule",
    "min_payment": "min payment",
    "mpg": "mpg",
    "new_card": "new card",
    "next_holiday": "next holiday",
    "next_song": "next song",
    "no": "no",
    "nutrition_info": "nutrition info",
    "oil_change_how": "oil change how",
    "oil_change_when": "oil change when",
    "oos": "oos",
    "order": "order",
    "order_checks": "order checks",
    "order_status": "order status",
    "pay_bill": "pay bill",
    "payday": "payday",
    "pin_change": "pin change",
    "play_music": "play music",
    "plug_type": "plug type",
    "pto_balance": "pto balance",
    "pto_request": "pto request",
    "pto_request_status": "pto request status",
    "pto_used": "pto used",
    "recipe": "recipe",
    "redeem_rewards": "redeem rewards",
    "reminder": "reminder",
    "reminder_update": "reminder update",
    "repeat": "repeat",
    "replacement_card_duration": "replacement card duration",
    "report_fraud": "report fraud",
    "report_lost_card": "report lost card",
    "reset_settings": "reset settings",
    "restaurant_reservation": "restaurant reservation",
    "restaurant_reviews": "restaurant reviews",
    "restaurant_suggestion": "restaurant suggestion",
    "rewards_balance": "rewards balance",
    "roll_dice": "roll dice",
    "rollover_401k": "rollover 401k",
    "routing": "routing",
    "schedule_maintenance": "schedule maintenance",
    "schedule_meeting": "schedule meeting",
    "share_location": "share location",
    "shopping_list": "shopping list",
    "shopping_list_update": "shopping list update",
    "smart_home": "smart home",
    "spelling": "spelling",
    "spending_history": "spending history",
    "sync_device": "sync device",
    "taxes": "taxes",
    "tell_joke": "tell joke",
    "text": "text",
    "thank_you": "thank you",
    "time": "time",
    "timer": "timer",
    "timezone": "timezone",
    "tire_change": "tire change",
    "tire_pressure": "tire pressure",
    "todo_list": "todo list",
    "todo_list_update": "todo list update",
    "traffic": "traffic",
    "transactions": "transactions",
    "transfer": "transfer",
    "translate": "translate",
    "travel_alert": "travel alert",
    "travel_notification": "travel notification",
    "travel_suggestion": "travel suggestion",
    "uber": "uber",
    "update_playlist": "update playlist",
    "user_name": "user name",
    "vaccines": "vaccines",
    "w2": "w2",
    "weather": "weather",
    "what_are_your_hobbies": "what are your hobbies",
    "what_can_i_ask_you": "what can i ask you",
    "what_is_your_name": "what is your name",
    "what_song": "what song",
    "where_are_you_from": "where are you from",
    "whisper_mode": "whisper mode",
    "who_do_you_work_for": "who do you work for",
    "who_made_you": "who made you",
    "yes": "yes"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 plug_type — plug type plug_type — plug type Same answer
Decider v1.1 plug_type — plug type plug_type — plug type Same answer
Jev plug_type — plug type plug_type — plug type Same answer
Microsoft Decision-1 plug_type — plug type plug_type — plug type Same answer
Clef plug_type — plug type plug_type — plug type Same answer
Luna Decisions plug_type — plug type plug_type — plug type Same answer
Clef Flash plug_type — plug type plug_type — plug type Same answer
Strands Decider plug_type — plug type plug_type — plug type Same answer
GLiNER2.5 Decide plug_type — plug type plug_type — plug type Same answer
Laya plug_type — plug type what_song — what song Different answer
CalDec v1 plug_type — plug type what_song — what song Different answer
Identifiers and recorded conditions

Variant ID: clinc150/7362bf12859b67fc2fdf/irrelevant_details/low/clean-source_first_classification_contexts_full_0148

Input fingerprint: ad272136bb66d46f760c63446bbd68fc933bfaecca6f8b735bc0a5e37960c5af

Change Recorded version
Irrelevant details Add a small amount of irrelevant detail

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.