| Example | Description |
|---|---|
| LiteLLM Audio Input Agent | Pass an MP3 file as audio input to a gpt-audio model routed through LiteLLM. |
| LiteLLM Basic | Run a Hugging Face Mistral model through LiteLLM with sync, async, and streaming calls. |
| LiteLLM Basic GPT | Call OpenAI’s gpt-4o through the LiteLLM model class for a basic agent response. |
| DB | Add storage to the Agent. |
| LiteLLM Image Agent | Analyze an image from a URL with gpt-4o via LiteLLM and pull related news using web search. |
| LiteLLM Image Agent Bytes | Send an image as raw bytes to gpt-4o via LiteLLM and fetch related news with web search. |
| LiteLLM Knowledge | Answer questions from a PDF knowledge base stored in PgVector using a LiteLLM agent. |
| LiteLLM Memory | Keep the last three runs in context and inspect stored session messages with a LiteLLM agent. |
| LiteLLM Metrics | Inspect per-message and run-level token metrics from a LiteLLM agent using YFinance tools. |
| LiteLLM PDF Input Bytes | Pass a downloaded PDF as raw bytes to a LiteLLM agent and summarize its contents. |
| LiteLLM PDF Input Local | Attach a local PDF file to a LiteLLM agent and ask questions about a specific recipe. |
| LiteLLM PDF Input URL | Attach a PDF by URL to a LiteLLM agent and ask for a recipe from the document. |
| LiteLLM Reasoning Agent Example | Use reasoning models through LiteLLM. |
| Retry | Review retry settings and why invalid model IDs cannot reliably exercise the retry path. |
| LiteLLM Structured Output | Return a MovieScript Pydantic model via LiteLLM using JSON mode and native structured outputs. |
| LiteLLM Tool Use | Call YFinance tools from a LiteLLM agent with sync, streaming, and async runs. |
| LiteLLM Append Trailing User Message | Append a trailing user turn so Claude 4.6+ models that reject assistant prefill work through LiteLLM. |
LiteLLM
LiteLLM
Run agents through the LiteLLM gateway with tools, knowledge, structured output, and audio, image, and PDF input.