Lookahead Lemmas Improve Neural Network Verification
A novel framework for neural network verification has been developed, utilizing a lookahead technique. This framework generates new lemmas based on the phases of unstable ReLUs, which are organized into an implication graph to streamline the search space and enhance boolean cuts. Implemented in two advanced verifiers, Marabou and α-β-CROWN, it has shown to improve performance by proving up to 34% more instances as unsatisfiable. The findings are detailed in a paper titled 'Learning Lookahead Lemmas for Neural Network Verification,' submitted to arXiv (ID 2607.29051) in the 'Computer Science > Machine Learning' category. The abstract notes that the new framework augments the branch-and-bound method used by leading verifiers, aiming to boost the efficiency and scalability of neural network verification, vital for the safety of AI systems. The paper is accessible on arXiv, featuring submission history and references, and aligns with arXiv's commitment to openness and collaborative projects through arXivLabs.
Key facts
- The framework uses a lookahead procedure to derive new lemmas.
- Lemmas are collected into an implication graph.
- The implication graph is used to prune the search space and vivify boolean cuts.
- The framework was instantiated in Marabou and α-β-CROWN.
- It improved performance in both verifiers.
- It proved up to 34% more instances unsatisfiable.
- The paper is titled 'Learning Lookahead Lemmas for Neural Network Verification'.
- The paper is available on arXiv with ID 2607.29051.
Entities
Institutions
- arXiv
- Marabou
- α-β-CROWN