exllamav2
Inference library for running local LLMs on consumer hardware.
homepage ↗ github: turboderp-org/exllamav2
Available in
| Overlay | Newest | Ebuilds | Last activity | |
|---|---|---|---|---|
| tatsh-overlay GitHub ↗ | 0.3.2 | 1 | 12 h | details › |
Inference library for running local LLMs on consumer hardware.
homepage ↗ github: turboderp-org/exllamav2
| Overlay | Newest | Ebuilds | Last activity | |
|---|---|---|---|---|
| tatsh-overlay GitHub ↗ | 0.3.2 | 1 | 12 h | details › |