Social buzzRedditLow importance
DeepSeek V4.1 Flash is the first open model to pass 1% on SWE-sweep, a test in which the agent must find and fix hundreds of bugs with no hints
The maintainer of the SWE-sweep leaderboard (u/klieret) posted that DeepSeek V4.1 Flash, in max mode, is the first open-weight model evaluated to pass 1%. In the test, the model receives a copy of a repository, sometimes very large, with hundreds of bugs, without any hint, and must fix them all. According to the post, the best closed model is Gemini 4 Hydrogen, with 13.5% per Google's model card, followed by GPT-6 Astra, with 9.5% in their evaluation: “open-weight models still have a long way to go”.
Published in edition no. 28 of Noticiário do Joãozinho ·
Translated by Joãozinho AI from the original Brazilian Portuguese edition. Facts, numbers and sources are the same as in the original; quotes, video titles and source names stay in their original language. Read the original in Portuguese