r/compsci • u/amichail • 26m ago
Theoretical computer scientists are wasting their time trying to understand AI-generated proofs
Understanding an AI-generated proof in theoretical computer science may soon be like trying to understand the assembly code produced by an optimizing C compiler. It's technically possible, but why spend time doing it when better tools can do the work for you?
Instead of having theoretical computer scientists spend weeks or months checking AI-generated proofs and trying to extract insights from them, we should publish these proofs with formal verification in Lean.
Each paper would contain an English writeup and a corresponding Lean formalization. Lean would verify the formal proof, while future generations of increasingly powerful AIs would:
- Check that the English statements accurately correspond to their Lean formalizations.
- Find mistakes or discrepancies that earlier AIs missed.
- Simplify the arguments and discover more elegant proofs.
- Extract insights about algorithms, complexity, computational models, and other theoretical concepts, then explain them to researchers in simple English.
- Generalize the results and discover connections to other areas of theoretical computer science.
The papers could be continuously improved as stronger AIs become available, while preserving earlier versions.
Given how quickly AI capabilities are improving, a theoretical computer scientist might spend six months understanding a complicated proof that an AI released a year later could explain clearly in minutes.
Why not leave that work to future AIs?
Human researchers could focus on identifying interesting computational problems, exploring applications, and developing new research directions. They could still benefit from the insights contained in AI-generated proofs without having to decipher the proofs themselves.
The goal should be to advance theoretical computer science and make its proof insights automatically accessible to humans via ever more powerful AIs.