All apps · 0 apps

vLLM

Official

Docker app from m0ngr31's Repository

Overview

Easy, fast, and cheap LLM serving for everyone

Requirements

Nvidia Driver plugin (nVidia Support)

Categories

Download Statistics

37,479,824

Total Downloads

4,523,290

This Month

3,315,025

Avg / Month

Total Downloads Over Time

Loading chart...

Related apps

Explore more like this

Links

Projectdocs.vllm.ai Supportdiscord.gg Docker Hubhub.docker.com Templateraw.githubusercontent.com

Details

Repository

vllm/vllm-openai

Registry

https://hub.docker.com/r/vllm/vllm-openai

Last Updated2026-10-04

First Seen2024-11-15

Runtime arguments

Web UI: http://[IP]:[PORT:8000]/
Shell: sh
Privileged: false
Extra Params: --runtime=nvidia --ipc=host

Template configuration

NVIDIA_VISIBLE_DEVICESVariable

Default: all
Value: all

NVIDIA_DRIVER_CAPABILITIESVariable

Default: all
Value: all

Model StoragePathrw

Target: /root/.cache/huggingface
Default: /mnt/user/appdata/vllm
Value: /mnt/user/appdata/vllm

PortPorttcp

Target: 8000
Default: 8000
Value: 8000

Hugging Face TokenVariable

Target: HUGGING_FACE_HUB_TOKEN