Domains¶
The public website exposes release-ready tasks tracked in the canonical ASI-Bench repository. This page summarizes the domain coverage of that public set.
Public Domain Snapshot¶
The breakdown below is rendered from generated website data.
Why Domain Coverage Matters¶
ASI-Bench is intended to evaluate scientific workflows rather than one narrow task family. Domain coverage matters because strong agent performance in one area, such as numerical PDE solving, does not automatically transfer to other areas such as computational biophysics or statistical physics.
Even in the current public slice, tasks already differ in:
- scientific framing
- data format and expected outputs
- runtime and package requirements
- evaluation methodology
- how much domain knowledge is needed to make progress
Current Public Policy¶
The domain summary reflects only final, approved, manually published Tasks in the checked-in ASI-Bench snapshot. Internal, test, and approved-but-not-published Tasks do not contribute to these counts.
As the benchmark matures, this page can evolve into:
- a richer domain map
- a domain comparison chart
- a landing page for domain-specific task browsing