Apocrypha

bitsandbytes

k-bit quantization (QLoRA) and 8-bit optimizers for PyTorch

homepage ↗ pypi: bitsandbytes github: bitsandbytes-foundation/bitsandbytes

Available in

OverlayNewestEbuildsLast activity
stuff GitHub ↗ 0.50.0 2 3 d details ›

Versions & arches

VersionOverlay amd64 Committed
0.50.0 ≈ stuff amd64 testing 3 d view · download · history ↗
0.49.2 ≈ stuff amd64 testing 22 d view · download · history ↗

Use flags of 0.50.0

  • rocm Build the HIP/ROCm GPU backend (COMPUTE_BACKEND=hip) instead of the CPU backend