AI Agents
Glossary Index

What is Function Calling / Tool Use?

Gururaj Pandurangi
Gururaj Pandurangi
Published: July 21, 2026
Updated: July 23, 2026

Definition & Overview

Function Calling / Tool Use is an LLM capability where the model detects when an external tool is required, formats a structured JSON function call, and uses the returned tool output to complete its response.

Enables LLMs to perform exact mathematical calculations, query live SQL databases, execute web searches, and trigger third-party API actions.

Analogy & Mental Model

Function Calling is like a manager handing a complex accounting problem to their CFO and receiving exact calculated numbers back before finishing a strategic deck.

Why Function Calling / Tool Use Matters

Tool Use transforms LLMs from static text generators into active problem-solving engines powering modern AI agents.

Concrete Real-World Application

ChatGPT calling a live WebSearch tool to pull weather reports before generating travel recommendations.

How Function Calling / Tool Use Works

Executes via JSON schema declaration and model tool-call generation.

Core Components & Mechanisms

Tool Specification

Providing the LLM with JSON schemas detailing available functions and arguments.

Tool Call Generation

The LLM emitting a structured `tool_calls` JSON payload instead of plain text.

Result Feeding & Generation

Executing the tool and feeding the output back into the LLM context to synthesize a final answer.

Function Calling / Tool Use vs Model Context Protocol (MCP)

Function calling enables an LLM to invoke specific function signatures, whereas Model Context Protocol (MCP) provides a standardized protocol for securely connecting LLMs to external tools and data.

Frequently Asked Questions

Do all major LLMs support Function Calling?

Yes, OpenAI, Anthropic Claude, Google Gemini, and open-source models like Llama 3 natively support structured function calling.

Knowledge Network

Articles & Research Referencing Function Calling / Tool Use

Explore Research Library

Get cited across ChatGPT, Perplexity & Gemini with citedby

Optimize your brand’s AI visibility score, track Share of Model across buyer prompts, and turn zero-click search into your highest-converting pipeline source.

Explore citedby Platform