flair/mastermind_24_mcq_random
Viewer
•
Updated
•
30.4k
•
98
MastermindEval
Prompting and multiple-choice (MCQ) benchmarks to evaluate reasoning capabilities of LLMs using Mastermind.
-
-
flair/mastermind_35_mcq_random
Viewer • Updated • 37.1k • 115 -
flair/mastermind_46_mcq_random
Viewer • Updated • 36.1k • 97 -
flair/mastermind_24_mcq_close
Viewer • Updated • 30.4k • 103 -
flair/mastermind_35_mcq_close
Viewer • Updated • 37.1k • 124 -
flair/mastermind_46_mcq_close
Viewer • Updated • 36.1k • 99 -
flair/mastermind_24_prompt
Viewer • Updated • 30.4k • 19 -
flair/mastermind_35_prompt
Viewer • Updated • 37.1k • 13 -
flair/mastermind_46_prompt
Viewer • Updated • 36.1k • 13 -
MastermindEval: A Simple But Scalable Reasoning Benchmark
Paper • 2503.05891 • Published • 1