ollama-intel-gpu
Docker 应用程序 from SpaceInvaderOne's Repository
概述
要求
运行时参数
- 网络用户界面
http://[IP]:[PORT:11434]/- 网络
bridge- 外壳
bash- 特权
- false
- 额外参数
--device=/dev/dri
模板配置
Path on the host for persistent model storage. Models are large (4-20 GB each).
- 目标
- /root/.ollama
- 默认值
- /mnt/user/appdata/ollama-intel-gpu
- 价值
- /mnt/user/appdata/ollama-intel-gpu
Port for the Ollama API.
- 目标
- 11434
- 默认值
- 11434
- 价值
- 11434
Allowed origins for CORS. Set to * to allow Open WebUI and other frontends to connect.
- 默认值
- *
- 价值
- *
Select which Intel GPU to use. Use level_zero:0 for the first GPU. Change only if you have multiple Intel GPUs.
- 默认值
- level_zero:0
- 价值
- level_zero:0
Number of parallel inference requests. Set to 1 for 12 GB VRAM cards (B580). Increase only if you have more VRAM.
- 默认值
- 1
- 价值
- 1
Context window size in tokens. Larger values use more VRAM. Default 4096 is a good balance for 12 GB cards.
- 默认值
- 4096
- 价值
- 4096
How long to keep a model loaded in VRAM after the last request. Use 5m for 5 minutes, -1 for forever, 0 to unload immediately.
- 默认值
- 5m
- 价值
- 5m
下载统计数据
详细信息
spaceinvaderone/ollama-intel-gpu在Unraid 上运行 ollama-intel-gpu 。
ollama-intel-gpu 已被列入Unraid OS 的社区应用程序。探索Unraid ,构建灵活的家庭服务器、NAS 或家庭实验室。