BRA-Audit: Budget-Aware Runtime Auditing for LLM Multi-Agent Systems
A new framework called BRA-Audit has been introduced by researchers to enhance budget-aware runtime auditing for LLM-based multi-agent systems (LLM-MAS), tackling the challenge of efficiency in auditing these systems. This framework represents the execution of MAS as a dynamic dependency graph and approaches audit scheduling by determining audit-point placement within a set audit-call budget to reduce overall unchecked exposure. Its greedy scheduler focuses on regions that are influential and have not been audited for a long time, while trusted components undergo less frequent audits. This strategy seeks to maintain guard performance and reduce token costs, addressing the risk of inter-agent dependencies leading to system-level failures. The paper can be found on arXiv under identifier 2608.14668.
Key facts
- BRA-Audit is a budget-aware runtime auditing framework for LLM-based multi-agent systems.
- It models MAS execution as a dynamic dependency graph.
- Audit scheduling is formulated as audit-point placement under a fixed audit-call budget.
- The goal is to minimize cumulative unchecked exposure.
- A greedy scheduler prioritizes influential and long-unaudited regions.
- Trusted components are audited less frequently.
- The approach addresses the efficiency dilemma between end-only auditing and auditing every agent each round.
- The paper is available on arXiv with identifier 2608.14668.
Entities
Institutions
- arXiv