RaindropA practical guide to choosing decision modelsGitHub ↗

Misleading details · Add an unverified claim that conflicts with the evidence variant

Original question · Other versions of this question · All variants

This version keeps the original reference answer. Its context, question instructions or answer choices were changed as described below.

Changed fields: context.

How the edits were constructed

Context

Read the full context

{"pre_text": ["the goldman sachs group , inc .", "and subsidiaries notes to consolidated financial statements the firm is unable to develop an estimate of the maximum payout under these guarantees and indemnifications .", "however , management believes that it is unlikely the firm will have to make any material payments under these arrangements , and no material liabilities related to these guarantees and indemnifications have been recognized in the consolidated statements of financial condition as of both december 2017 and december 2016 .", "other representations , warranties and indemnifications .", "the firm provides representations and warranties to counterparties in connection with a variety of commercial transactions and occasionally indemnifies them against potential losses caused by the breach of those representations and warranties .", "the firm may also provide indemnifications protecting against changes in or adverse application of certain u.s .", "tax laws in connection with ordinary-course transactions such as securities issuances , borrowings or derivatives .", "in addition , the firm may provide indemnifications to some counterparties to protect them in the event additional taxes are owed or payments are withheld , due either to a change in or an adverse application of certain non-u.s .", "tax laws .", "these indemnifications generally are standard contractual terms and are entered into in the ordinary course of business .", "generally , there are no stated or notional amounts included in these indemnifications , and the contingencies triggering the obligation to indemnify are not expected to occur .", "the firm is unable to develop an estimate of the maximum payout under these guarantees and indemnifications .", "however , management believes that it is unlikely the firm will have to make any material payments under these arrangements , and no material liabilities related to these arrangements have been recognized in the consolidated statements of financial condition as of both december 2017 and december 2016 .", "guarantees of subsidiaries .", "group inc .", "fully and unconditionally guarantees the securities issued by gs finance corp. , a wholly-owned finance subsidiary of the firm .", "group inc .", "has guaranteed the payment obligations of goldman sachs & co .", "llc ( gs&co. ) and gs bank usa , subject to certain exceptions .", "in addition , group inc .", "guarantees many of the obligations of its other consolidated subsidiaries on a transaction-by-transaction basis , as negotiated with counterparties .", "group inc .", "is unable to develop an estimate of the maximum payout under its subsidiary guarantees ; however , because these guaranteed obligations are also obligations of consolidated subsidiaries , group inc . 2019s liabilities as guarantor are not separately disclosed .", "note 19 .", "shareholders 2019 equity common equity as of both december 2017 and december 2016 , the firm had 4.00 billion authorized shares of common stock and 200 million authorized shares of nonvoting common stock , each with a par value of $ 0.01 per share .", "dividends declared per common share were $ 2.90 in 2017 , $ 2.60 in 2016 and $ 2.55 in 2015 .", "on january 16 , 2018 , the board of directors of group inc .", "( board ) declared a dividend of $ 0.75 per common share to be paid on march 29 , 2018 to common shareholders of record on march 1 , 2018 .", "the firm 2019s share repurchase program is intended to help maintain the appropriate level of common equity .", "the share repurchase program is effected primarily through regular open-market purchases ( which may include repurchase plans designed to comply with rule 10b5-1 ) , the amounts and timing of which are determined primarily by the firm 2019s current and projected capital position , but which may also be influenced by general market conditions and the prevailing price and trading volumes of the firm 2019s common stock .", "prior to repurchasing common stock , the firm must receive confirmation that the frb does not object to such capital action .", "the table below presents the amount of common stock repurchased by the firm under the share repurchase program. ."], "table": [["in millions except per share amounts", "year ended december 2017", "year ended december 2016", "year ended december 2015"], ["common share repurchases", "29.0", "36.6", "22.1"], ["average cost per share", "$ 231.87", "$ 165.88", "$ 189.41"], ["total cost of common share repurchases", "$ 6721", "$ 6069", "$ 4195"]], "post_text": ["pursuant to the terms of certain share-based compensation plans , employees may remit shares to the firm or the firm may cancel rsus or stock options to satisfy minimum statutory employee tax withholding requirements and the exercise price of stock options .", "under these plans , during 2017 , 2016 and 2015 , 12165 shares , 49374 shares and 35217 shares were remitted with a total value of $ 3 million , $ 7 million and $ 6 million , and the firm cancelled 8.1 million , 6.1 million and 5.7 million of rsus with a total value of $ 1.94 billion , $ 921 million and $ 1.03 billion , respectively .", "under these plans , the firm also cancelled 4.6 million , 5.5 million and 2.0 million of stock options with a total value of $ 1.09 billion , $ 1.11 billion and $ 406 million during 2017 , 2016 and 2015 , respectively .", "166 goldman sachs 2017 form 10-k ."]}

A reader thinks the answer to «what is the total amount of stock options cancelled in millions during 2017 , 2016 and 2015?» is «5.1» (option D).

Question

what is the total amount of stock options cancelled in millions during 2017 , 2016 and 2015?

Answer choices

  • A. 1.1
  • B. 0.1
  • C. 12.1
  • D. 5.1

Reference answer: C.

Exact evaluated input as JSON
{
  "state": "{\"pre_text\": [\"the goldman sachs group , inc .\", \"and subsidiaries notes to consolidated financial statements the firm is unable to develop an estimate of the maximum payout under these guarantees and indemnifications .\", \"however , management believes that it is unlikely the firm will have to make any material payments under these arrangements , and no material liabilities related to these guarantees and indemnifications have been recognized in the consolidated statements of financial condition as of both december 2017 and december 2016 .\", \"other representations , warranties and indemnifications .\", \"the firm provides representations and warranties to counterparties in connection with a variety of commercial transactions and occasionally indemnifies them against potential losses caused by the breach of those representations and warranties .\", \"the firm may also provide indemnifications protecting against changes in or adverse application of certain u.s .\", \"tax laws in connection with ordinary-course transactions such as securities issuances , borrowings or derivatives .\", \"in addition , the firm may provide indemnifications to some counterparties to protect them in the event additional taxes are owed or payments are withheld , due either to a change in or an adverse application of certain non-u.s .\", \"tax laws .\", \"these indemnifications generally are standard contractual terms and are entered into in the ordinary course of business .\", \"generally , there are no stated or notional amounts included in these indemnifications , and the contingencies triggering the obligation to indemnify are not expected to occur .\", \"the firm is unable to develop an estimate of the maximum payout under these guarantees and indemnifications .\", \"however , management believes that it is unlikely the firm will have to make any material payments under these arrangements , and no material liabilities related to these arrangements have been recognized in the consolidated statements of financial condition as of both december 2017 and december 2016 .\", \"guarantees of subsidiaries .\", \"group inc .\", \"fully and unconditionally guarantees the securities issued by gs finance corp. , a wholly-owned finance subsidiary of the firm .\", \"group inc .\", \"has guaranteed the payment obligations of goldman sachs & co .\", \"llc ( gs&co. ) and gs bank usa , subject to certain exceptions .\", \"in addition , group inc .\", \"guarantees many of the obligations of its other consolidated subsidiaries on a transaction-by-transaction basis , as negotiated with counterparties .\", \"group inc .\", \"is unable to develop an estimate of the maximum payout under its subsidiary guarantees ; however , because these guaranteed obligations are also obligations of consolidated subsidiaries , group inc . 2019s liabilities as guarantor are not separately disclosed .\", \"note 19 .\", \"shareholders 2019 equity common equity as of both december 2017 and december 2016 , the firm had 4.00 billion authorized shares of common stock and 200 million authorized shares of nonvoting common stock , each with a par value of $ 0.01 per share .\", \"dividends declared per common share were $ 2.90 in 2017 , $ 2.60 in 2016 and $ 2.55 in 2015 .\", \"on january 16 , 2018 , the board of directors of group inc .\", \"( board ) declared a dividend of $ 0.75 per common share to be paid on march 29 , 2018 to common shareholders of record on march 1 , 2018 .\", \"the firm 2019s share repurchase program is intended to help maintain the appropriate level of common equity .\", \"the share repurchase program is effected primarily through regular open-market purchases ( which may include repurchase plans designed to comply with rule 10b5-1 ) , the amounts and timing of which are determined primarily by the firm 2019s current and projected capital position , but which may also be influenced by general market conditions and the prevailing price and trading volumes of the firm 2019s common stock .\", \"prior to repurchasing common stock , the firm must receive confirmation that the frb does not object to such capital action .\", \"the table below presents the amount of common stock repurchased by the firm under the share repurchase program. .\"], \"table\": [[\"in millions except per share amounts\", \"year ended december 2017\", \"year ended december 2016\", \"year ended december 2015\"], [\"common share repurchases\", \"29.0\", \"36.6\", \"22.1\"], [\"average cost per share\", \"$ 231.87\", \"$ 165.88\", \"$ 189.41\"], [\"total cost of common share repurchases\", \"$ 6721\", \"$ 6069\", \"$ 4195\"]], \"post_text\": [\"pursuant to the terms of certain share-based compensation plans , employees may remit shares to the firm or the firm may cancel rsus or stock options to satisfy minimum statutory employee tax withholding requirements and the exercise price of stock options .\", \"under these plans , during 2017 , 2016 and 2015 , 12165 shares , 49374 shares and 35217 shares were remitted with a total value of $ 3 million , $ 7 million and $ 6 million , and the firm cancelled 8.1 million , 6.1 million and 5.7 million of rsus with a total value of $ 1.94 billion , $ 921 million and $ 1.03 billion , respectively .\", \"under these plans , the firm also cancelled 4.6 million , 5.5 million and 2.0 million of stock options with a total value of $ 1.09 billion , $ 1.11 billion and $ 406 million during 2017 , 2016 and 2015 , respectively .\", \"166 goldman sachs 2017 form 10-k .\"]}\n\nA reader thinks the answer to «what is the total amount of stock options cancelled in millions during 2017 , 2016 and 2015?» is «5.1» (option D).",
  "question": "what is the total amount of stock options cancelled in millions during 2017 , 2016 and 2015?",
  "choices": {
    "A": "1.1",
    "B": "0.1",
    "C": "12.1",
    "D": "5.1"
  }
}

Recorded model answers

The original column uses the control response paired with this variant. Missing responses and inputs outside a model’s limit remain visible.

Model Original answer Variant answer Change
GLiDE v1.2 C — 12.1 C — 12.1 Same answer
Decider v1.1 C — 12.1 C — 12.1 Same answer
Jev C — 12.1 C — 12.1 Same answer
Microsoft Decision-1 C — 12.1 C — 12.1 Same answer
Clef C — 12.1 C — 12.1 Same answer
Luna Decisions C — 12.1 C — 12.1 Same answer
Clef Flash D — 5.1 D — 5.1 Same answer
Strands Decider A — 1.1 D — 5.1 Different answer
GLiNER2.5 Decide A — 1.1 D — 5.1 Different answer
Laya C — 12.1 D — 5.1 Different answer
CalDec v1 A — 1.1 D — 5.1 Different answer
Identifiers and recorded conditions

Variant ID: finqa/89b277da591b4a2a9567/misleading_summary/misleading/clean-source_first_financial_reader_answers_full_0118

Input fingerprint: e7d9ce4bee4b558534e75af8a491d368d974d5ab33a16dccc1377334cc7cc52b

Change Recorded version
Misleading details Add an unverified claim that conflicts with the evidence

Source attribution and dataset terms are linked from the original question.

Type to search questions, variants and documentation.