ollama-bin

Get up and running with large language models locally

Ollama is a tool for running large language models (LLMs) locally on your machine. It provides a simple interface to download, run, and manage models like Llama 3.2, Mistral, Gemma, and many others. This is a binary distribution package that installs pre-built binaries from the official Ollama releases. The binaries are provided under the MIT license and include GPU acceleration support for both NVIDIA (CUDA) and AMD (ROCm) graphics cards. Key features: - Easy model management with pull, push, and create commands - Built-in API server for programmatic access - GPU acceleration support (CUDA and ROCm) - Efficient memory management with automatic model loading/unloading - Support for multiple models and concurrent requests - Compatible with OpenAI API format Models are stored in /var/lib/ollama and can range from 2GB (3B parameters) to 40GB+ (70B parameters) in size. GPU acceleration significantly improves inference speed but requires compatible hardware. Security Note: This package installs pre-compiled binaries. Security hardening features (ASLR, PIE, stack protections) depend on upstream's build configuration. The service runs as a dedicated 'ollama' user with restricted permissions for defense in depth.

homepage ↗ github: ollama/ollama