ollama-intel-gpu
ollama-intel-gpu
Docker-Anwendung from SpaceInvaderOne's Repository
Übersicht
Anforderungen
Laufzeit-Argumente
- Web-UI
http://[IP]:[PORT:11434]/- Netzwerk
bridge- Shell
bash- Privilegiert
- false
- Extra Params
--device=/dev/dri
Konfiguration der Vorlage
Path on the host for persistent model storage. Models are large (4-20 GB each).
- Ziel
- /root/.ollama
- Standard
- /mnt/user/appdata/ollama-intel-gpu
- Wert
- /mnt/user/appdata/ollama-intel-gpu
Port for the Ollama API.
- Ziel
- 11434
- Standard
- 11434
- Wert
- 11434
Allowed origins for CORS. Set to * to allow Open WebUI and other frontends to connect.
- Standard
- *
- Wert
- *
Select which Intel GPU to use. Use level_zero:0 for the first GPU. Change only if you have multiple Intel GPUs.
- Standard
- level_zero:0
- Wert
- level_zero:0
Number of parallel inference requests. Set to 1 for 12 GB VRAM cards (B580). Increase only if you have more VRAM.
- Standard
- 1
- Wert
- 1
Context window size in tokens. Larger values use more VRAM. Default 4096 is a good balance for 12 GB cards.
- Standard
- 4096
- Wert
- 4096
How long to keep a model loaded in VRAM after the last request. Use 5m for 5 minutes, -1 for forever, 0 to unload immediately.
- Standard
- 5m
- Wert
- 5m
Kategorien
Statistik herunterladen
Einzelheiten
spaceinvaderone/ollama-intel-gpuFühren Sie ollama-intel-gpu auf Unraid aus.
ollama-intel-gpu ist gelistet in Community Apps für Unraid OS. Erkunden Sie Unraid, um einen flexiblen Heimserver, ein NAS oder ein Heimlabor aufzubauen.