Toolformer
Era 5 · Generative AI, reasoning, and agents (2022–2026) › Agents
- Lineage
- Acting in the world
- Kind
- Publication
Who
Meta, Pompeu Fabra University
What happened
Timo Schick and colleagues at Meta AI Research and Pompeu Fabra University present Toolformer, a language model that teaches itself when to call an external tool, such as a calculator, a search engine, or a translator, and how to use the response.
Why it mattered
The model learns when to call a tool from just a few examples of each one. A small model with tools competes with much larger ones.
The full story
Large language models could handle surprising tasks, yet they failed at things an ordinary program finds easy: exact arithmetic, up-to-date facts, or today's date. The obvious fix was to give them tools, but teaching them to use tools required many examples annotated by people.
Toolformer learned in a self-supervised way. With only a few examples of how to call each interface, the model inserted possible calls into texts, executed them, and kept only those that helped it better predict the text that followed. It was fine-tuned on that data, and so it learned when a tool call was worth making, which tool to use, with what inputs, and how to incorporate the result.
The tools were a calculator, a question-answering system, two search engines, a translator, and a calendar. Toolformer improved results on a range of tasks without task-specific training, often matching much larger models, without losing its general ability as a language model.
It was presented at NeurIPS 2023.
Builds on
ReAct (October 6, 2022)
Independent convergence
Both papers give a language model external tools, from different directions: one with examples in the prompt, the other with self-supervised data
Sources
Original source
- Toolformer: Language Models Can Teach Themselves to Use Tools (arXiv:2302.04761) (opens in a new tab). Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, and Thomas Scialom, 2023
Scholarship and context
How to cite
“Toolformer.” The History of AI, revised November 13, 2026. https://thehistoryofai.com/en/milestone/toolformer
This entry was last reviewed on November 13, 2026.