Hyperstack
Single-GPU to 8-GPU VMs on A100 80GB PCIe, H100 PCIe and L40 for fine-tuning and inference, billed per minute with no data-transfer fees
We may earn commissions when you shop through the links below. Learn more
Ollama runs open-weight models behind a local HTTP API. Compare GPU and CPU hosts with official templates or documentation for Ollama, and size the GPU by the memory your model needs.
The Ollama server binds 127.0.0.1 on port 11434 by default. The OLLAMA_HOST environment variable changes the bind address.
Ollama supports NVIDIA GPUs with compute capability 5.0 or higher and driver version 550 or newer; GPUs with compute capability 5.0 to 6.2 need driver 570 or newer.
Ollama Cloud is Ollama's own hosted service, separate from self-hosting. Ollama hosts those models and compute primarily in the United States and may route to Europe and Singapore for capacity.
Open-source agent from Nous Research
Always-on agent gateway, formerly Clawdbot
Local models behind an HTTP API
You are on this page
High-throughput inference server
Open-source LLM app and workflow builder
Low-code builder for LLM flows and agents
Filters match a provider when one of its listed offers meets every GPU, VRAM, region, price and billing-increment condition together. Spot, reserved and serverless billing list each provider that offers that pricing and show only prices on that basis, or “not verified” when we have none. Read the full methodology and our affiliate disclosure.
Roughly the size of the quantised model weights plus room for the context window. The VRAM / Model Fit tool estimates this for a specific model and precision.
Install it on a GPU server or VPS; it serves an HTTP API on port 11434, bound to 127.0.0.1 by default. To reach it remotely, keep it behind a VPN, an SSH tunnel or an authenticating reverse proxy rather than opening it with OLLAMA_HOST to the internet.
No. Ollama Cloud runs models on Ollama's own infrastructure, which Ollama says is primarily in the United States (ollama.com/pricing, accessed 27 Sep 2026). Self-hosting means running Ollama on a server or GPU you rent, which is what this page compares.
Yes, small quantised models run on CPU, but token generation is much slower than on a GPU. Larger models need a GPU with enough VRAM.