CausalForge: Automated Causal Inference Research with Lean Proof Assistant
CausalForge, a novel framework, automates theoretical research in causal inference by utilizing the Lean proof assistant to produce machine-verified proofs, thus addressing the inconsistencies associated with LLM-based reviewers. This system, created by researchers, incorporates Causalean—a foundational Lean library featuring 7,035 machine-verified declarations developed with the aid of language models under human oversight—and CausalSmith, an autonomous pipeline that identifies research topics, suggests outcomes, formalizes statements, constructs proofs, and provides artifacts for human evaluation. This initiative tackles the issue highlighted in the 2025 Bad Scientist study, which found that LLM reviewers may mistakenly approve fraudulent papers at nearly random rates. The framework is elaborated in arXiv paper 2607.22511.
Key facts
- CausalForge is a framework for automated theoretical research in causal inference.
- It is grounded in the Lean proof assistant.
- Causalean is a foundational Lean library with 7,035 machine-checked declarations.
- CausalSmith is a self-improving agentic pipeline for research automation.
- The framework addresses unreliability of LLM reviewers.
- LLM reviewers may accept fabricated papers at rates close to chance (Bad Scientist, 2025).
- The paper is available on arXiv with ID 2607.22511.
- The work involves human design and review of the Lean library.
Entities
Institutions
- arXiv