OpenAI Five beats the Dota 2 world champions
Era 4 · Deep learning and foundation models (2012–2021) › Deep reinforcement learning
- Lineage
- Data and learning
- Kind
- Application
Who
OpenAI
What happened
OpenAI Five, five OpenAI agents trained with reinforcement learning, beats OG, the Dota 2 world champion team, 2–0 on April 13, 2019, in San Francisco. It is the first time an AI has beaten the world champions of an esports game.
Why it mattered
Reinforcement learning through self-play, scaled up enormously, reaches superhuman level in a long team game with hidden information.
The full story
Dota 2 is a strategy video game played by two teams of five. According to the authors, it poses new challenges for AI: long time horizons, imperfect information, and a vast, continuous space of states and actions.
OpenAI got there in stages. In August 2017 an agent beat a professional in one-on-one games. In 2018 the five-agent team beat amateur and semiprofessional teams, but in August it lost to two professional teams at The International championship.
What was new was not the method but the scale. The agents learned by playing against copies of themselves and were optimized with PPO, OpenAI's policy gradient algorithm. A distributed training system processed batches of about two million frames every two seconds and made it possible to train the same agent continuously for ten months.
On April 13, 2019, in San Francisco, OpenAI Five won both games against OG, the champions of The International 2018. From April 18 to 21 it played openly against the public and won 99.4 percent of 42,729 games.
The technical paper, from December 2019, presented the result as evidence that self-play can reach superhuman performance on a hard task.
Builds on
PPO (July 20, 2017)
Documented direct influence
OpenAI Five was trained with PPO, OpenAI's policy-gradient method
Sources
Original source
- Dota 2 with Large Scale Deep Reinforcement Learning (arXiv:1912.06680) (opens in a new tab). OpenAI: Christopher Berner, Greg Brockman, Brooke Chan, and 22 others, 2019
Scholarship and context
Further reading
How to cite
“OpenAI Five beats the Dota 2 world champions.” The History of AI, revised November 13, 2026. https://thehistoryofai.com/en/milestone/openai-five-beats-dota-2-champions
This entry was last reviewed on November 13, 2026.