ARTFEED — Contemporary Art Intelligence

Metadata Gaps Limit Scholarly AI Attribution in Nexus-Score Study

ai-technology · 2026-07-29

A recent study published on arXiv (2607.22684) indicates that the absence of metadata hampers AI systems in accurately attributing scientific contributions. Researchers evaluated an AI system that cited works without access to pertinent paper lists, resulting in the generation of identifiers that were sometimes non-existent. By utilizing OpenAlex records, they either concealed or reinstated author, institution, funder, reference, and text-access links while keeping the works and tasks constant. When the appropriate link was restored, attribution was possible; however, incorrect link restoration yielded zero correct responses out of 469 mismatched tests. Missing links resulted in fabricated responses, refusals, or depletion of tool budgets, and web searches did not recover concealed author links. The study concludes that AI systems can only credit works when the relevant record connections are visible.

Key facts

  • Study titled 'Towards Nexus-Score: Metadata Gaps Limit Scholarly AI Attribution'
  • Published on arXiv with ID 2607.22684
  • AI system citing without access to task-relevant paper lists produced out-of-list identifiers, some fabricated
  • Used OpenAlex records to hide or restore metadata links
  • Restoring the wrong kind of link resulted in 0 correct answers across 469 mismatched tests
  • Missing links led to invented answers, refusals, or tool-budget exhaustion
  • Web search did not recover hidden author links
  • AI systems credited work only when record connections were visible

Entities

Institutions

  • arXiv
  • OpenAlex

Sources