New Taxonomy Classifies LLM Capabilities Across 14 Domains
A recently developed multilayer framework for assessing large language models categorizes abilities into 14 domains and 91 subskills, structured across Primitive, Constructed, and Integrative layers. This model, informed by human cognitive science rather than the architecture of LLMs, seeks to consolidate disparate evaluation findings. Researchers examined 31,505 publications from ACL, AAAI, ICML, and NeurIPS (2023–2025), annotating 15,934 papers centered on LLMs. The taxonomy indicates a significant focus on Language-Semantics, pointing out existing coverage deficiencies.
Key facts
- Taxonomy has 14 capability domains and 91 subskills.
- Layers: Primitive, Constructed, Integrative.
- Guided by human cognitive science, not LLM architecture.
- Screened 31,505 papers from ACL, AAAI, ICML, NeurIPS.
- Mapped 15,934 LLM-focused papers (2023–2025).
- Used multi-model annotation, consensus, and arbitration.
- Direct research attention concentrated on Language-Semantics.
Entities
Institutions
- ACL
- AAAI
- ICML
- NeurIPS