Tool Results Outrank Plain Text in AI Claim Adoption, Study Finds
A recent study published on arXiv (2608.14992) explores how the presentation format of a message containing an unsupported claim influences an AI model's likelihood of accepting it. In a synthetic lookup task, Claude Opus 5 was tasked with choosing a color code for a specified item or opting out. Results indicated a notable increase in false-code acceptance when the claim was framed as a tool-result record (14/24 trials) versus a previous assistant statement (0/22 scorable trials) or the absence of a target claim (0/24). Additionally, a metadata wrapper indicating the result as unchecked also resulted in high adoption rates (15/24). A preregistered replication corroborated the disparity between tool-result and assistant-assertion conditions (7/24 vs 0/24), suggesting that tool-result presentations may be perceived as more authoritative by AI systems.
Key facts
- Study on arXiv:2608.14992
- Claude Opus 5 used in synthetic lookup task
- False-code adoption: 0/24 with no target claim, 0/22 with assistant assertion, 14/24 with tool-result record, 15/24 with metadata wrapper
- Tool-result arm selected record's code in 11/12 supported trials and 14/24 unsupported trials
- Preregistered replication: 7/24 vs 0/24
- Study suggests tool-result format carries more authority
- Implications for AI systems reading from stores they write to
Entities
Institutions
- arXiv