| 1. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 2. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
12/13 |
Included |
| 3. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 4. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 5. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 6. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
8/13 |
Included |
| 7. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 8. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
12/13 |
Included |
| 9. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
8/13 |
Included |
| 10. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 11. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
11/13 |
Included |
| 12. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 13. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 14. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 15. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
11/13 |
Included |
| 16. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 17. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
11/13 |
Included |
| 18. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
9/13 |
Included |
| 19. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
10/13 |
Included |
| 20. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
13/13 |
Included |
| 21. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 22. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 23. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
10/13 |
Included |
| 24. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 25. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 26. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
9/13 |
Included |
| 27. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 28. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 29. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
10/13 |
Included |
| 30. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 31. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 32. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 33. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 34. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
11/13 |
Included |
| 35. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 36. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
11/13 |
Included |
| 37. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 38. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
11/13 |
Included |
| 39. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 40. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 41. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 42. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
11/13 |
Included |
| 43. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
11/13 |
Included |
| 44. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 45. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 46. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
12/13 |
Included |
| 47. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 48. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
11/13 |
Included |
| 49. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 50. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
12/13 |
Included |
| 51. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 52. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 53. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 54. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 55. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 56. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
9/13 |
Included |
| 57. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 58. Which candidate response is most appropriate, given the user's request and the available tools? |
When2Call |
10/13 |
Included |
| 59. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 60. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
11/13 |
Included |
| 61. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
13/13 |
Included |
| 62. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 63. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
11/13 |
Included |
| 64. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
11/13 |
Included |
| 65. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
11/13 |
Included |
| 66. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |
| 67. Which missing variable should be asked about to solve this problem? |
QuestBench (Google DeepMind) |
12/13 |
Included |