ShaQ: Localizing Input Uncertainty in LLMs via Shapley Values
A new framework called Shapley-based input uncertainty Quantification (ShaQ) has been introduced by researchers to address span-level attribution of uncertainty induced by inputs in large language models (LLMs). Existing techniques focus on output levels and do not differentiate between gaps in knowledge and ambiguities in input. ShaQ offers detailed, practical insights into which segments of the input contribute to uncertainty. This research has been made available on arXiv under the identifier 2605.28170.
Key facts
- ShaQ stands for Shapley-based input uncertainty Quantification
- It addresses input-centric uncertainty quantification
- Current methods provide only scalar uncertainty scores
- ShaQ offers span-level attribution
- The framework targets high-stakes decision-making
- Published on arXiv with ID 2605.28170
- It distinguishes model knowledge gaps from input ambiguity
- Aims to improve reliability and trust in LLMs
Entities
Institutions
- arXiv