xAI's Colossus
Era 5 · Generative AI, reasoning, and agents (2022–2026) › Infrastructure and compute
- Lineage
- Machines and computation
- Kind
- Implementation
Who
xAI
What happened
xAI switches on Colossus in a former Electrolux plant in south Memphis: a supercomputer of 100,000 Nvidia H100 GPUs built in 122 days. Three months later it expands it to 200,000 GPUs.
Why it mattered
It shows the speed and scale at which compute for AI is being built, and the environmental and energy costs that come with it.
The full story
xAI, the AI company founded by Elon Musk, needed compute to train its Grok models. It installed its supercomputer, Colossus, in a former Electrolux factory in south Memphis.
The supercomputer started up with 100,000 Nvidia H100 GPUs and was built in 122 days. Three months after installing the first 100,000, xAI announced that it had doubled the system to 200,000 GPUs. By June 2025 it combined 150,000 H100s, 50,000 H200s, and 30,000 GB200s, and its peak power draw had risen from 150 to 250 megawatts.
The speed came at a cost. The site's grid connection was at first only 8 megawatts, and xAI installed gas turbines to make up the difference. In November 2024 the grid connection rose to 150 megawatts and some turbines were removed, but not all: in April 2025 aerial images showed 35, with a combined capacity of 422 megawatts. The Southern Environmental Law Center, a group of environmental lawyers, calculated from the manufacturer's data that the facility emits between 1,200 and 2,000 tons of nitrogen oxides, the gases that form smog, which would probably make it the largest industrial source of those gases in the Memphis area.
Colossus became an emblem of the race for compute: a data center put up in months, drawing hundreds of megawatts.
Leads to
Grok 3 (February 17, 2025)
Documented direct influence
xAI trains Grok 3 on its Colossus supercomputer
Sources
Scholarship and context
- Musk’s xAI buys third building to expand AI compute power (Reuters, in The Star, December 31, 2025) (opens in a new tab). Harshita Mary Varghese (Reuters), 2025
Further reading
How to cite
“xAI's Colossus.” The History of AI, revised November 13, 2026. https://thehistoryofai.com/en/milestone/xai-colossus
This entry was last reviewed on November 13, 2026.