Error category

Ollama Errors and Fixes

Troubleshoot Ollama local server, model load, cloud API, timeout, runner crash, memory, GPU, and connection errors for local and hosted inference.

This Ollama troubleshooting hub collects real error signatures, quick fixes, common causes, and step-by-step debugging paths for developers who need a practical answer instead of a broad overview.

125 crawlable articles in this category. 50 additional records are indexed in JSON only (no standalone HTML route).

Browse Ollama records in the data catalog — search JSON index entries, including data-only records without standalone HTML guides.

Troubleshooting overview

Start by matching the exact error message, then check the technology, environment, credentials, network path, and deployment context. The pages below are grouped so you can move from broad Ollama symptoms to specific root-cause families without relying on client-side search.

Evidence labels are derived at build time from each Markdown record. Source-backed entries have public URLs under a Sources checked section, while partial-source entries expose public links without a complete source block.

Ollama diagnostic workflow

  1. Copy the exact error signature and compare it with the page title, code block, and technology label.
  2. Check whether the failure is local, CI-only, deployment-only, provider-side, or account-specific.
  3. Collect non-secret versions, configuration names, request IDs, and timestamps before making changes.
  4. Review source-backed or partial-source pages first when the issue might depend on provider behavior or version-specific bugs.
  5. Apply the smallest reversible fix and rerun the same failing action.

Common error types

  • connection refused
  • 500 internal server error
  • 503 service unavailable
  • model failed to load
  • runner process terminated
  • read timeout

Common causes

  • GitHub Issue #16326 on ollama/ollama repo: race condition where parallel API requests get empty string responses when another request is loading the model into VRAM/KV Cache. Raw streaming mode affected. Clear error behavior in multi-user/concurrent scenarios. Category: Ollama per mapping. (1 page)
  • Source: GitHub Issue #16261 on ollama/ollama (opened May 22, 2026, within last hour). Crash in ggml_backend_tensor_set function triggered during partial GPU offload on AMD Radeon RX 9070 — a newly released GPU. Segfault represents a hard blocking error preventing model loading entirely on this hardware. High search demand as new GPU adoption grows. Duplicate check: not in covered-errors.md. Category: Ollama → local LLM serving with hardware-specific error. (1 page)
  • Ollama is a widely used local LLM platform. Connection refused errors block all local AI inference, affecting developers running self-hosted models for cost savings or privacy. (1 page)
  • Sentry-reported production issue: ConnectError [Errno 111] Connection refused when connecting to Ollama API. Multiple instances traced to httpcore connection failure. (1 page)
  • GitHub issue #16298 on ollama/ollama. Plain text Read works fine, direct top-level image content request works, but specifically Claude Code + Ollama combination with PNG through Read tool fails. Affects developers running local LLMs via Ollama with Claude Code. Category = Ollama per approved mapping. (1 page)
  • Stack Overflow user reports MCP server fails to connect in VS Code Continue extension when Ollama runs in Docker container on WSL2. Ollama reachable at localhost:11434 but Continue extension doesn't see MCP tools. WSL2/Docker networking and stdio transport issue. Category is Ollama (local LLM serving + MCP integration). (1 page)

Related technologies

  • Ollama Cloud
  • local inference
  • GGUF models
  • GPU runners

Troubleshooting clusters

  • Local server connection errors
  • Model load and manifest errors
  • Memory and GPU runtime errors
  • Cloud API availability errors
  • Streaming timeout errors
  • Tool call parsing errors

Latest pages in this category

Representative source-backed errors

These entries include public source URLs in the imported page body. Use them first when you need evidence for provider behavior, SDK regressions, or version-specific failures.

Safe debugging checklist

  • Do not paste API keys, tokens, cookies, private repository snippets, or customer data into public issues.
  • Keep a rollback path before changing credentials, billing limits, DNS, CI secrets, or production deploy settings.
  • Prefer official documentation and source-backed entries over broad guesses when the error affects paid APIs or production deploys.

Top fixes

High-intent troubleshooting topics

  • how to fix Ollama errors
  • Ollama error fix
  • Ollama troubleshooting
  • Ollama authentication failed
  • Ollama timeout
  • Ollama permission denied
  • Ollama deployment failed
Ollama Ollama

Ollama Pull Model Manifest Failures and Out-of-Memory Crashes on Self-Hosted Inference

Self-hosted developer tries to pull/run large models in Ollama but encounters manifest download failures (HuggingFace rate limit or proxy issues) or GPU OOM crashes needing VRAM management fixes. Includes evidence for Ollama troubleshooting demand.

pull model manifest: file does not exist OR CUDA error: out of memory OR pulling manifest 429
Ollama Ollama

Ollama Docker Pull Model Manifest TLS Handshake Timeout on Restricted Networks

Running Ollama inside Docker container behind restricted network/firewall/proxy cannot pull models from registry due to TLS handshake timeout; needs proxy configuration or DNS fix workaround Includes evidence for Ollama troubleshooting demand.

Error: pull model manifest: Get https://registry.ollama.ai/v2/library/<model>/manifests/latest: net/http: TLS handshake timeout
Ollama Ollama

Ollama Pull Model Manifest Timeout TLS Handshake Fails on Docker Containers

Fix Ollama model pull failures caused by TLS handshake timeouts, DNS resolution failures, and network connectivity issues in Docker/Wsl environments Includes evidence for Ollama troubleshooting demand.

Error: pull model manifest: Get "https://registry.ollama.ai/v2/library/.../manifests/latest": net/http: TLS handshake timeout; dial tcp: lookup registry.ollama.ai: read udp ...: i/o timeout; Connection reset mid-download restarting from 0%
Ollama Ollama

Ollama 'pull model manifest: file does not exist' — network proxy/HF token issues

Fix Ollama model download failures caused by proxy misconfiguration, HuggingFace rate limiting (429), and missing environment variables during manifest fetching. Includes evidence for Ollama troubleshooting demand.

Error: pull model manifest: file does not exist / max retries exceeded: unexpected EOF / pull model manifest: 429
Ollama Ollama

Ollama tool calling not streaming on macOS with MLX backend, causing timeout

Fix Ollama tool calls freezing and timing out on Apple Silicon Macs with MLX backend, specifically when generating large code outputs via write tool Includes evidence for Ollama troubleshooting demand.

Tool calling is not streaming on macOS with MLX, causing timeout when write tool outputs large code
Ollama Ollama

Ollama Pulling Manifest Errors Including File Does Not Exist and SSH No Key Found

Fix Ollama model download failures due to manifest pulling errors including missing files, SSH key issues, DNS resolution failures, and version compatibility Includes evidence for Ollama troubleshooting demand.

Error: pull model manifest: file does not exist; also 'ssh: no key found', 'no such host', and 'pulling manifest: 412: requires newer version'
Ollama Ollama

AMD Radeon RX 9070 partial offload segfaults in ggml_backend_tensor_set

Developers with new AMD GPUs (Radeon RX 9070) experience segfaults when Ollama partially offloads model inference to GPU via ggml backend tensor operations Includes evidence for Ollama troubleshooting demand.

partial offload segfaults in ggml_backend_tensor_set on AMD Radeon RX 9070
Ollama Ollama

Ollama Python API error: llama-server response bufio.Scanner token too long

Developers integrating Ollama via Python API get token-too-long errors when llama-server outputs responses exceeding bufio.Scanner buffer limits, breaking LLM pipeline processing Includes evidence for Ollama troubleshooting demand.

bufio.Scanner: token too long (status code: -1) — Error from the python API: llama-server response
Ollama Ollama

Ollama 'Connection Refused' — Local LLM Service Unreachable on Port 11434

Developer tries to run Ollama locally but gets connection refused errors — service isn't running, port conflict, or firewall blocking local connections — preventing local LLM inference Includes evidence for Ollama troubleshooting demand.

Error: connection refused at localhost:11434 OR dial tcp [::1]:11434: connect: connection refused
Ollama Ollama

Ollama GPU initialization failure — nvidia-smi works but ollama refuses to use GPU

Developer runs ollama inside a Docker/container environment where nvidia-smi reports GPUs fine but ollama falls back to CPU or crashes during model loading; needs to know correct NVIDIA driver/toolkit version pinning for Ollama 20.x Includes evidence for Ollama troubleshooting demand.

Ollama fails to initialize GPU despite nvidia-smi working correctly from within container
Ollama Ollama

Ollama potential OOM crash during GGUF metadata parsing in recent versions

Fix Ollama crash caused by unbounded memory allocation when parsing large GGUF model files — particularly affects loading quantized models on systems with limited RAM Includes evidence for Ollama troubleshooting demand.

Potential OOM crash during GGUF metadata parsing in v0.24.0 (readString/n_kv allocation)
Ollama Ollama

Ollama pulls HF GGUF models but returns Error: 400 (empty body)

Fix Ollama HuggingFace GGUF model download that completes transfer but then fails with HTTP 400 empty body response Includes evidence for Ollama troubleshooting demand.

Error: 400 (empty body) when pulling hf.co GGUF models after successful download
Ollama Ollama

Ollama 500 Internal Server Error — MLX Runner Fails on Linux NVIDIA GPUs

Ollama operator on Linux with NVIDIA GPU getting MLX (Apple Silicon runner) fallback errors when pulling multi-modal models, blocking model deployment Includes evidence for Ollama troubleshooting demand.

500 Internal Server Error: mlx runner failed: Error: failed to initialize MLX — ollama pulling x/z-image-turbo model on Rocky Linux 9.7 with NVIDIA RTX 4000 SFF Ada
Ollama Ollama

OllamaLLM Streaming Uses Stop Sequences as Finish Reason in LangChain Integration

Fix LangChain + Ollama integration where streaming completions incorrectly use stop_sequences as finish_reason, causing early termination or garbled output in production LLM pipelines. Includes evidence for Ollama troubleshooting demand.

OllamaLLM streaming in LangChain returns stop sequences as finish_reason instead of proper completion signal, breaking streaming pipelines

Browse all Ollama troubleshooting pages

Continue through the full static archive for this hub. Every listed page is crawlable and keeps its existing canonical URL.

Browse all Ollama troubleshooting pages