Function Calling

Full definition

Function calling was popularized by OpenAI in June 2023 and is now standard across Anthropic, Google, and open models. The model is fine-tuned to recognize when a user request maps to a tool, fill arguments from the conversation, and return a parseable structure. It is the substrate beneath tool use, agents, and structured-output applications. Pitfalls: hallucinated arguments, schema drift, and mishandling of parallel calls.

Why it matters

Function calling is the contract between probabilistic LLMs and deterministic enterprise systems. Done well, it lets LLMs participate safely in databases, payments, and workflows. Done poorly, it is the leading cause of agent failures in production.

Example

A finance copilot exposes get_transaction(id) and refund_transaction(id, amount). The LLM resolves "refund the duplicate charge from yesterday" into two function calls; the application enforces the actual authorization.

Related terms

• Tool Use (LLM)
  LLM tool use (also called function calling) is the ability of a language model to invoke external functions, APIs, databases, or systems based on the user's request — turning the LLM from a text generator into a controller that can act on the world.
• Agentic Workflow
  An agentic workflow is a multi-step AI process where a model plans, takes actions through tools, observes results, and iterates toward a goal — replacing single-shot prompting with a loop that reasons, acts, and self-corrects.
• AI Agent / Agentic AI
  An AI agent is an LLM-driven system that, given a goal, plans a sequence of steps, calls tools or APIs, observes the results, and iterates until the goal is reached — going beyond single-turn chat to multi-step autonomous action.
• AI Guardrails
  AI guardrails are the layered controls — input filters, output classifiers, policy engines, schema validation, and structured generation — that constrain an AI system to safe, on-policy, and on-task behavior.