DeepSeek-Prover-V2 and Its Formal Math Results

Matthew Berman highlights DeepSeek’s reported theorem-proving results on miniF2F, PutnamBench and formalized AIME problems.

MBMatthew BermanVortrag · Forward Future
Kanal
Matthew Berman
Veröffentlicht
1. Mai 2025
Video
0:34
Lesezeit
1 Min.
Folien
1
Original
Englisch
Auf YouTube öffnen
Beim Scrollen schrumpft das Video in die rechte untere Ecke und läuft weiter. Untertitel folgen Ihrer Lesesprache.
LesespracheIn 2 Sprachen verfügbar
Diesen Artikel gibt es noch nicht auf Deutsch, daher wird das Original (Englisch) angezeigt.
ZUSAMMENFASSUNG

In 30 Sekunden

Matthew Berman briefly introduces DeepSeek-Prover-V2 and cites a DeepSeek researcher’s benchmark claims. The results concern formal mathematical proof under specific evaluation conditions, not general success at all math problems.

  1. 1A model for mathematical proofsBerman introduces DeepSeek-Prover-V2 and highlights its mathematical capabilities.
  2. 2miniF2F and PutnamBenchA DeepSeek researcher reports nearly 90% on miniF2F and improvement on PutnamBench. The results depend on the model and evaluation budget.
  3. 3Formalized AIME problemsThe researcher also reports a nontrivial result on formal versions of selected AIME 2024 and 2025 problems.

Das Wichtigste

  1. DeepSeek-Prover-V2 is designed for formal theorem proving in Lean 4.
  2. DeepSeek reports 88.9% on miniF2F-test for its 671B model with up to 8,192 attempts per problem.
  3. The researchers report 49 of 658 PutnamBench problems solved and results on selected formalized AIME questions.
  4. The video reports the researchers’ results and does not independently test the model.
VOLLTEXT

Den bearbeiteten Text nach Kapiteln lesen

Nur das Transkript
01

DeepSeek-Prover-V2

Berman introduces the model and its focus on mathematics. The release concerns formal theorem proving.

DeepSeek, the company behind DeepSeek-R1, has released DeepSeek-Prover-V2. I am impressed by its reported performance on mathematics. The model is aimed at formal theorem proving in Lean 4, a more specific task than solving arbitrary math equations.

02

Reported benchmark results

He cites a researcher’s claims on miniF2F and PutnamBench. The comparison uses specific proof-search conditions.

According to a DeepSeek researcher, the model solves nearly 90% of miniF2F problems and substantially improves results on PutnamBench. The [technical report](https://arxiv.org/abs/2504.21801) reports 88.9% on the miniF2F test set for the 671B model with up to 8,192 proof attempts per problem, and 49 of 658 PutnamBench problems solved. These are researcher-reported results under particular evaluation conditions, not a single-attempt success rate.

03

AIME and comparison

Berman highlights results on formalized AIME problems and a chart comparing models. He encourages viewers to try the model.

DeepSeek’s reported proof benchmarks
FOLIE 1 / 1DeepSeek’s reported proof benchmarksThe chart compares reported miniF2F, PutnamBench and selected AIME results; evaluation settings differ.

The researcher also reports a nontrivial success rate on formalized AIME 2024 and 2025 problems. The report’s ProverBench includes 15 selected AIME problems; the comparison shown distinguishes formal proof generation from an informal answer task. The chart shows substantial differences between the listed models, and I encourage viewers to try DeepSeek-Prover-V2. This short video does not independently test the claims.

Mehr aus diesem Kanal

12 Folien34:21EN
Matthew Berman· 27. Okt. 2026Matthew Berman Examines Anthropic’s IPO Filing, AI Growth and GovernanceMatthew Berman, Sam Altman · Forward FutureThe presenter reviews the S-1’s financial metrics, compute strategy and voting structure while questioning the tension between rapid AI development and safety.AnthropicAI SafetyEnterprise-KI+2
2 Folien0:36EN
Matthew Berman· 25. Okt. 2026Kimi K3.1 and a Rubik’s Cube Solver DemonstrationMatthew Berman · Forward FutureMatthew Berman shows a scrambled virtual cube being solved and gives the Kimi K3.1 test a favorable assessment.EvalsCoding-AgentenOpen-weight models
6 Folien25:50EN
Matthew Berman· 24. Okt. 2026Kimi K3.1 Pro Tested: Strong 3D Demos, Uneven Results and Competitive PricingMatthew Berman · Forward FutureMatthew Berman tests the open-weight model on coding, 3D rendering and visual explanations, then compares benchmark results and prices.Open-weight modelsBenchmarksAI cost & performance+1
2 Folien32:20EN
Matthew Berman· 23. Okt. 2026Who Is Local AI For? The Costs, Trade-offs and a Hybrid FutureMatthew Berman · Forward FutureMatthew Berman weighs data control and independence against hardware cost, setup complexity and inference speed.Local inferenceOpen-weight modelsAI cost & performance+1
6 Folien1:03:37EN
Matthew Berman· 23. Okt. 2026Matthew Berman’s Team Tests Kimi K3.1 on Animation, Games, and ChartsMatthew Berman, Alex, Brian · Forward FutureA live team AMA turns into an informal test of Kimi K3.1, from personal-agent workflows to motion graphics, a browser game, and a benchmark chart.Coding-AgentenGenerative mediaEvals+2
0:53EN
Matthew Berman· 22. Okt. 2026Sam Altman on AI and the Discovery of New KnowledgeSam Altman · OpenAIAltman expects progress in mathematical discovery to extend to biology, materials and energy.AI for scienceMathematicsComputational Biology+1