The History of AI

GitHub Copilot

Era 4 · Deep learning and foundation models (2012–2021) › Transformers and language models

Lineage
Neurons and networks
Kind
Application

Who

GitHub, OpenAI

What happened

On June 29, 2021, GitHub opens a technical preview of Copilot, an "AI pair programmer" that suggests whole lines or functions as you type. It runs on Codex, a system from OpenAI.

Why it mattered

It brings a large language model into the everyday work of programming, right inside the code editor.

The full story

The engine behind Copilot is Codex, a GPT language model fine-tuned on public code from GitHub. OpenAI described it in a paper posted to arXiv on July 7, 2021, eight days after the announcement. The authors explain that they started from GPT models that were already trained because fine-tuning then converged faster, and that a distinct production version of Codex is what powers Copilot.

To measure it, the paper introduces HumanEval, a set of problems that checks whether a program written from a description actually works. Codex solved 28.8 percent of the problems; GPT-3, which had not been trained on code, solved none, and GPT-J, an open model of the time, 11.4 percent.

The tool works inside the editor. It reads the context of the code being written and proposes anything from a single line to a whole function. According to the announcement, a technical preview signed by Nat Friedman, it also helps explore alternative solutions, write tests, and use unfamiliar libraries without leaving to search the web.

Builds on

  • GPT-3 (May 28, 2020)

    Documented direct influence

    Copilot runs on Codex, a GPT language model fine-tuned on code from GitHub. Its authors start from the GPT-3 family because fine-tuning converges faster, and a production version of Codex powers Copilot

Sources

How to cite

“GitHub Copilot.” The History of AI, revised November 13, 2026. https://thehistoryofai.com/en/milestone/github-copilot

This entry was last reviewed on November 13, 2026.

Open in the interactive timeline