BIG-bench

A collaborative benchmark of 204 tasks built to probe large language models beyond single-metric tests, spanning reasoning, knowledge, creativity, and multilingual ability. Contributed by 450 authors across 132 institutions, with canary strings to detect training-data contamination.