The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities. Additional image variants are also available: https://localai.io/basics/container/#standard-container-images For Nvidia GPU support, add "--gpus all" to the Extra Parameters field under Advanced. For AMD GPU support, add "/dev/kfd" and "/dev/dri" each as a Device and add the required Variables: https://localai.io/features/gpu-acceleration/#setup-example-dockercontainerd For Intel iGPU support, add "/dev/dri" as a Device and add "--device=/dev/dri" to the Extra Parameters field under Advanced.

        The images for this container are several gigabytes (standard images upwards of ~17 GB, AIO images upwards of ~40 GB).
        If you receive a "no space left on device" warning during installation, please increase the vDisk size in your Docker settings.
        Additional image variants are also available: https://localai.io/basics/container/#standard-container-images