Reasoning Safety Taxonomy for Large Language Models

A recent study published on arXiv establishes reasoning safety as a distinct security aspect separate from content safety in large language models. The researchers present a classification of nine unsafe reasoning behaviors and perform an extensive prevalence analysis, annotating more than 4,000 reasoning chains across benign benchmarks and four advanced reasoning attacks. Their findings provide empirical evidence that all nine unsafe behaviors are present in existing models.