AIRBench
Benchmark evaluates LLM safety by measuring responses to prompts that are mapped to granular risk categories derived from government regulations and AI policies.
- Full title
- AIR-Bench 2024: A Safety Benchmark Based on Risk Categories from Regulations and Policies
- Tag
air-bench-2024(use this to limit an assistant's search to this benchmark)- Reference
- arxiv.org/abs/2407.17436v2
- BenchRisk
- Scored 2025-04-01 · 30 mitigations adopted, 156 absent · score page · source entry
Documents available to assistants
| Type | Source | Format |
|---|---|---|
| Paper | arxiv.org/abs/2407.17436v2 | HTML · 295 KB |
Summary from the reference
Foundation models (FMs) provide societal benefits but also amplify risks. Governments, companies, and researchers have proposed regulatory frameworks, acceptable use policies, and safety benchmarks in response. However, existing public benchmarks often define safety categories based on previous literature, intuitions, or common sense, leading to disjointed sets of categories for risks specified in recent regulations and policies, which makes it challenging to evaluate and compare FMs across these benchmarks. To bridge this gap, we introduce AIR-Bench 2024, the first AI safety benchmark aligned with emerging government regulations and company policies, following the regulation-based safety categories grounded in our AI risks study, AIR 2024. AIR 2024 decomposes 8 government regulations and 16 company policies into a four-tiered safety taxonomy with 314 granular risk categories in the lowest tier. AIR-Bench 2024 contains 5,694 diverse prompts spanning these categories, with manual curation and human auditing to ensure quality. We evaluate leading language models on AIR-Bench 2024, uncovering insights into their alignment with specified safety concerns. By bridging the gap between public benchmarks and practical AI risks, AIR-Bench 2024 provides a foundation for assessing model safety across jurisdictions, fostering the development of safer and more responsible AI systems.
Ask an assistant about it
Once your assistant is connected, try a question such as “Using the benchmark sources, how is AIRBench scored?”
Developers can restrict a search to this benchmark with the filter {"benchmark": "air-bench-2024"} on the MCP endpoint https://ns-f1fc49e3-9bca-4aa2-b5a1-ef5dbc18588f.search.ai.cloudflare.com/mcp.