The History of AI

Toolformer

Era 5 · Generative AI, reasoning, and agents (2022–2026) › Agents

Lineage
Acting in the world
Kind
Publication

Who

Meta, Pompeu Fabra University

What happened

Timo Schick and colleagues at Meta AI Research and Pompeu Fabra University present Toolformer, a language model that teaches itself when to call an external tool, such as a calculator, a search engine, or a translator, and how to use the response.

Why it mattered

The model learns when to call a tool from just a few examples of each one. A small model with tools competes with much larger ones.

The full story

Large language models could handle surprising tasks, yet they failed at things an ordinary program finds easy: exact arithmetic, up-to-date facts, or today's date. The obvious fix was to give them tools, but teaching them to use tools required many examples annotated by people.

Toolformer learned in a self-supervised way. With only a few examples of how to call each interface, the model inserted possible calls into texts, executed them, and kept only those that helped it better predict the text that followed. It was fine-tuned on that data, and so it learned when a tool call was worth making, which tool to use, with what inputs, and how to incorporate the result.

The tools were a calculator, a question-answering system, two search engines, a translator, and a calendar. Toolformer improved results on a range of tasks without task-specific training, often matching much larger models, without losing its general ability as a language model.

It was presented at NeurIPS 2023.

Builds on

  • ReAct (October 6, 2022)

    Independent convergence

    Both papers give a language model external tools, from different directions: one with examples in the prompt, the other with self-supervised data

Sources

Original source

How to cite

“Toolformer.” The History of AI, revised November 13, 2026. https://thehistoryofai.com/en/milestone/toolformer

This entry was last reviewed on November 13, 2026.

Open in the interactive timeline