Researcher Agents for Knowledge-Graph Question Answering
A recent paper on arXiv (2608.07700) presents an innovative text-to-SPARQL system that enhances traditional static tool-using agents. This new researcher agent can iteratively refine its prompts, rules, and tool orchestration code following each inference round on a validation set. The implementation utilizes DBpedia, resulting in nine evolving versions of the agent, driven by a cost-effective reasoning model. The top-performing setup employs two more robust backbone models. Notable findings indicate rapid self-improvement, achieving an overall accuracy of 0.22 on the 2025 DBpedia validation set, with persistent challenges in basic-graph-pattern generation. The paper also tackles issues in converting natural-language queries into SPARQL, including lexical ambiguity and ensuring syntactic and semantic accuracy in graph patterns.
Key facts
- arXiv paper 2608.07700
- Agentic text-to-SPARQL system
- Researcher agent proposes and tests changes to its own prompts, rules, and tool-orchestration code
- Instantiated on DBpedia
- Nine successive versions of the agent evolved
- Driven by a low-cost reasoning model
- Best-performing configuration deployed with two stronger backbone models
- 0.22 overall accuracy on the 2025 DBpedia validation set
- Bottleneck in basic-graph-pattern generation
Entities
Institutions
- arXiv
- DBpedia