> ## Documentation Index
> Fetch the complete documentation index at: https://agno-v2-docs-scavio-google-v2.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# vLLM

> vLLM is a fast and easy-to-use library for running LLM models locally.

| Example                                                           | Description                                                                              |
| ----------------------------------------------------------------- | ---------------------------------------------------------------------------------------- |
| [vLLM Basic](/examples/models/vllm/basic)                         | Run a Qwen2.5-7B agent on a local vLLM server in sync, async, and streaming modes.       |
| [Code Generation](/examples/models/vllm/code-generation)          | Code generation example with DeepSeek-Coder.                                             |
| [DB](/examples/models/vllm/db)                                    | Store a vLLM agent's session history in Postgres and reuse it across turns.              |
| [Memory](/examples/models/vllm/memory)                            | Personalized memory and session summaries with vLLM.                                     |
| [Retry](/examples/models/vllm/retry)                              | Review retry settings and why invalid model IDs cannot reliably exercise the retry path. |
| [vLLM Structured Output](/examples/models/vllm/structured-output) | Return a typed MovieScript object from a vLLM agent with a Pydantic output schema.       |
| [vLLM Tool Use](/examples/models/vllm/tool-use)                   | Build a web search agent using vLLM.                                                     |