arXiv Paper Proposes Two-Sided Audit for AI Science Claims

A new study that's just come out on arXiv (2608.00981) introduces a two-pronged auditing method to evaluate how self-improving AI systems claim to enhance scientific research. The researchers argue that typical metrics—like benchmark differences and p-values—don't really distinguish real progress from mere noise caused by factors like extra searches or tweaks to unreliable oracles. Interestingly, they found that a certain type of oracle can't accurately represent a crossing base pair, restricting the earlier verifier's effectiveness. They discovered that a flawed oracle can inflate capability claims, with a specific operator succeeding on 43 of 60 RNA targets using its optimized predictor, compared to none with a standard model. The study underscores the need for careful validation in AI-driven scientific discovery.