> ## Documentation Index
> Fetch the complete documentation index at: https://phidatainc.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Llama Cpp

> Run agents against a local llama.cpp server serving `ggml-org/gpt-oss-20b-GGUF` at `http://127.0.0.1:8080/v1`.

| Example                                                                     | Description                                                                              |
| --------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------- |
| [Llama Cpp Basic](/examples/models/llama-cpp/basic)                         | Run a local GGUF model with LlamaCpp and print sync and streamed responses.              |
| [Retry](/examples/models/llama-cpp/retry)                                   | Review retry settings and why invalid model IDs cannot reliably exercise the retry path. |
| [Llama Cpp Structured Output](/examples/models/llama-cpp/structured-output) | Generate a MovieScript Pydantic object from a local LlamaCpp model with output\_schema.  |
| [Tool Use](/examples/models/llama-cpp/tool-use)                             | Give a local LlamaCpp model web search tools and stream the tool-assisted answer.        |