ACE-Step

ACE-Step

Docker app from SpaceInvaderOne's Repository

Overview

ACE-Step 1.5 - AI Music Generation. Generate full songs with vocals, instrumentals, and lyrics using a Diffusion Transformer. Supports text-to-music, remixing, cover generation, and LoRA fine-tuning. Requires NVIDIA GPU with CUDA support.

FIRST RUN: Models (~10GB) will be downloaded automatically on first start. This may take several minutes depending on your internet speed. Subsequent starts are instant.

SETTINGS GUIDE:

DiT Model - The core music generation model.

  • turbo (default): Fast generation in 8 steps. Best for most users.
  • turbo-rl: Turbo with reinforcement learning refinement.
  • sft: Higher quality, 50 steps (slower).
  • base: 50 steps with all features (extract, lego, complete).

Language Model - Controls lyrics understanding and chain-of-thought reasoning.

  • 1.7B (default): Best balance of quality and VRAM. Recommended for 12-16GB GPUs.
  • 0.6B: For GPUs with less than 12GB VRAM.
  • 4B: Highest quality lyrics understanding. Requires 24GB+ VRAM.

Enable LLM - Whether to load the language model.

  • auto (default): Detects based on your GPU VRAM.
  • false: DiT-only mode. Faster startup, uses less VRAM, but disables thinking/sample features.
  • true: Force enable.

LM Backend - Engine for the language model.

  • pt (default): PyTorch native. Works on all GPUs including RTX 50-series.
  • vllm: Faster inference but may crash on RTX 50-series (Blackwell) GPUs.

CPU Offloading - Moves models between GPU and CPU to save VRAM.

  • auto (default): Offloads if GPU has less than 20GB VRAM.
  • false: Keep all models on GPU. Faster generation but uses ~12GB VRAM at idle.
  • true: Always offload. Slower but frees VRAM for other containers.

UI Language - Web interface language: English, Chinese, or Japanese.

ACE-Step 1.5

Pushing the Boundaries of Open-Source Music Generation

ACEMusic | Project | Hugging Face | ModelScope | Space Demo | Discord | Technical Report | Awesome ACE-Step

StepFun Logo ย ย  ACEMusic - Try ACE-Step Online

๐Ÿ“ฐ News

๐ŸŽต Want a faster & more stable experience? Try acemusic.ai โ€” 100% free!

  • [2026-04-02] ๐ŸŽ‰ ACE-Step 1.5 XL (4B DiT) Released! โ€” We introduce the XL series with a 4B-parameter DiT decoder for higher audio quality. Three variants available: xl-base, xl-sft, xl-turbo. Requires โ‰ฅ12GB VRAM (with offload), โ‰ฅ20GB recommended. All LM models fully compatible. See Model Zoo for details.

Table of Contents

๐Ÿ“ Abstract

๐Ÿš€ We present ACE-Step v1.5, a highly efficient open-source music foundation model that brings commercial-grade generation to consumer hardware. On commonly used evaluation metrics, ACE-Step v1.5 achieves quality beyond most commercial music models while remaining extremely fastโ€”under 2 seconds per full song on an A100 and under 10 seconds on an RTX 3090. The model runs locally with less than 4GB of VRAM, and supports lightweight personalization: users can train a LoRA from just a few songs to capture their own style.

๐ŸŒ‰ At its core lies a novel hybrid architecture where the Language Model (LM) functions as an omni-capable planner: it transforms simple user queries into comprehensive song blueprintsโ€”scaling from short loops to 10-minute compositionsโ€”while synthesizing metadata, lyrics, and captions via Chain-of-Thought to guide the Diffusion Transformer (DiT). โšก Uniquely, this alignment is achieved through intrinsic reinforcement learning relying solely on the model's internal mechanisms, thereby eliminating the biases inherent in external reward models or human preferences. ๐ŸŽš๏ธ

๐Ÿ”ฎ Beyond standard synthesis, ACE-Step v1.5 unifies precise stylistic control with versatile editing capabilitiesโ€”such as cover generation, repainting, and vocal-to-BGM conversionโ€”while maintaining strict adherence to prompts across 50+ languages. This paves the way for powerful tools that seamlessly integrate into the creative workflows of music artists, producers, and content creators. ๐ŸŽธ

โœจ Features

ACE-Step Framework

โšก Performance

  • โœ… Ultra-Fast Generation โ€” Under 2s per full song on A100, under 10s on RTX 3090 (0.5s to 10s on A100 depending on think mode & diffusion steps)
  • โœ… Flexible Duration โ€” Supports 10 seconds to 10 minutes (600s) audio generation
  • โœ… Batch Generation โ€” Generate up to 8 songs simultaneously

๐ŸŽต Generation Quality

  • โœ… Commercial-Grade Output โ€” Quality beyond most commercial music models (between Suno v4.5 and Suno v5)
  • โœ… Rich Style Support โ€” 1000+ instruments and styles with fine-grained timbre description
  • โœ… Multi-Language Lyrics โ€” Supports 50+ languages with lyrics prompt for structure & style control

๐ŸŽ›๏ธ Versatility & Control

Feature Description
โœ… Reference Audio Input Use reference audio to guide generation style
โœ… Cover Generation Create covers from existing audio
โœ… Repaint & Edit Selective local audio editing and regeneration
โœ… Track Separation Separate audio into individual stems
โœ… Multi-Track Generation Add layers like Suno Studio's "Add Layer" feature
โœ… Vocal2BGM Auto-generate accompaniment for vocal tracks
โœ… Metadata Control Control duration, BPM, key/scale, time signature
โœ… Simple Mode Generate full songs from simple descriptions
โœ… Query Rewriting Auto LM expansion of tags and lyrics
โœ… Audio Understanding Extract BPM, key/scale, time signature & caption from audio
โœ… LRC Generation Auto-generate lyric timestamps for generated music
โœ… LoRA Training One-click annotation & training in Gradio. 8 songs, 1 hour on 3090 (12GB VRAM)
โœ… Quality Scoring Automatic quality assessment for generated audio

๐Ÿ”” Staying ahead

Star ACE-Step on GitHub and be instantly notified of new releases

๐Ÿค Partners

ComfyUI Zilliz Milvus Zeabur Majik's Music Studio

โšก Quick Start

๐ŸŽต Don't want to install locally? Try acemusic.ai โ€” 100% free, no GPU required!

Requirements: Python 3.11-3.12, CUDA GPU recommended (also supports MPS / ROCm / Intel XPU / CPU)

Note: ROCm on Windows requires Python 3.12 (AMD officially provides Python 3.12 wheels only)

# 1. Install uv
curl -LsSf https://astral.sh/uv/install.sh | sh          # macOS / Linux
# powershell -ExecutionPolicy ByPass -c "irm https://astral.sh/uv/install.ps1 | iex"  # Windows

# 2. Clone & install
git clone https://github.com/ACE-Step/ACE-Step-1.5.git
cd ACE-Step-1.5
uv sync

# 3. Launch Gradio UI (models auto-download on first run)
uv run acestep

# Or launch REST API server
uv run acestep-api

Open http://localhost:7860 (Gradio) or http://localhost:8001 (API).

๐Ÿ“ฆ Windows users: A portable package with pre-installed dependencies is available. See Installation Guide.

๐Ÿ“ฆ MacOS users: A portable package with pre-installed dependencies is available. See Installation Guide.

๐Ÿ“– Full installation guide (AMD/ROCm, Intel GPU, CPU, environment variables, command-line options): English | ไธญๆ–‡ | ๆ—ฅๆœฌ่ชž

๐Ÿ’ก Which Model Should I Choose?

Your GPU VRAM Recommended DiT Recommended LM Model Backend Notes
โ‰ค6GB 2B turbo None (DiT only) โ€” LM disabled by default; INT8 quantization + full CPU offload
6-8GB 2B turbo acestep-5Hz-lm-0.6B pt Lightweight LM with PyTorch backend
8-16GB 2B turbo/sft acestep-5Hz-lm-0.6B / 1.7B vllm 0.6B for 8-12GB, 1.7B for 12-16GB
16-20GB 2B sft or XL turbo acestep-5Hz-lm-1.7B vllm XL requires CPU offload below 20GB
20-24GB XL turbo/sft acestep-5Hz-lm-1.7B vllm XL fits without offload; 4B LM available
โ‰ฅ24GB XL sft (or xl-base for extract/lego/complete) acestep-5Hz-lm-4B vllm Best quality, all models fit without offload

XL (4B) models (acestep-v15-xl-*) offer higher audio quality with ~9GB VRAM for weights (vs ~4.7GB for 2B). They require โ‰ฅ12GB VRAM (with offload + quantization) or โ‰ฅ20GB (without offload). All LM models are fully compatible with XL.

The UI automatically selects the best configuration for your GPU. All settings (LM model, backend, offloading, quantization) are tier-aware and pre-configured.

๐Ÿ“– GPU compatibility details: English | ไธญๆ–‡ | ๆ—ฅๆœฌ่ชž | ํ•œ๊ตญ์–ด

๐Ÿš€ Launch Scripts

Ready-to-use launch scripts for all platforms with auto environment detection, update checking, and dependency installation.

Platform Scripts Backend
Windows start_gradio_ui.bat, start_api_server.bat CUDA
Windows (ROCm) start_gradio_ui_rocm.bat, start_api_server_rocm.bat AMD ROCm
Linux start_gradio_ui.sh, start_api_server.sh CUDA
macOS start_gradio_ui_macos.sh, start_api_server_macos.sh MLX (Apple Silicon)
# Windows
start_gradio_ui.bat

# Linux
chmod +x start_gradio_ui.sh && ./start_gradio_ui.sh

# macOS (Apple Silicon)
chmod +x start_gradio_ui_macos.sh && ./start_gradio_ui_macos.sh

โš™๏ธ Customizing Launch Settings

Recommended: Create a .env file to customize models, ports, and other settings. Your .env configuration will survive repository updates.

# Copy the example file
cp .env.example .env

# Edit with your preferred settings
# Examples in .env:
ACESTEP_CONFIG_PATH=acestep-v15-turbo
ACESTEP_LM_MODEL_PATH=acestep-5Hz-lm-1.7B
PORT=7860
LANGUAGE=en

๐Ÿ“– Script configuration & customization: English | ไธญๆ–‡ | ๆ—ฅๆœฌ่ชž

๐Ÿ“š Documentation

Usage Guides

Method Description Documentation
๐Ÿ–ฅ๏ธ Gradio Web UI Interactive web interface for music generation Guide
๐Ÿงญ UI Support Baseline Supported UI boundary and future UI parity checklist Guide
๐ŸŽ›๏ธ VST3 Plugin Standalone VST3 plugin (C++/GGML) for DAW integration acestep.vst3
๐Ÿ Python API Programmatic access for integration Guide
๐ŸŒ REST API HTTP-based async API for services Guide
โŒจ๏ธ CLI Interactive wizard and configuration Guide

Setup & Configuration

Topic Documentation
๐Ÿ“ฆ Installation (all platforms) English | ไธญๆ–‡ | ๆ—ฅๆœฌ่ชž
๐ŸŽฎ GPU Compatibility English | ไธญๆ–‡ | ๆ—ฅๆœฌ่ชž
๐Ÿ”ง GPU Troubleshooting English
๐Ÿ”ฌ Benchmark & Profiling English | ไธญๆ–‡

Multi-Language Docs

Language API Gradio Inference Tutorial LoRA Training Install Benchmark
๐Ÿ‡บ๐Ÿ‡ธ English Link Link Link Link Link Link Link
๐Ÿ‡จ๐Ÿ‡ณ ไธญๆ–‡ Link Link Link Link Link Link Link
๐Ÿ‡ฏ๐Ÿ‡ต ๆ—ฅๆœฌ่ชž Link Link Link Link Link Link โ€”
๐Ÿ‡ฐ๐Ÿ‡ท ํ•œ๊ตญ์–ด Link Link Link Link Link โ€” โ€”

๐Ÿ“– Tutorial

๐ŸŽฏ Must Read: Comprehensive guide to ACE-Step 1.5's design philosophy and usage methods.

Language Link
๐Ÿ‡บ๐Ÿ‡ธ English English Tutorial
๐Ÿ‡จ๐Ÿ‡ณ ไธญๆ–‡ ไธญๆ–‡ๆ•™็จ‹
๐Ÿ‡ฏ๐Ÿ‡ต ๆ—ฅๆœฌ่ชž ๆ—ฅๆœฌ่ชžใƒใƒฅใƒผใƒˆใƒชใ‚ขใƒซ

This tutorial covers: mental models and design philosophy, model architecture and selection, input control (text and audio), inference hyperparameters, random factors and optimization strategies.

๐Ÿ”จ Train

๐Ÿ“– LoRA Training Tutorial โ€” step-by-step guide covering data preparation, annotation, preprocessing, and training:

Language Link
๐Ÿ‡บ๐Ÿ‡ธ English LoRA Training Tutorial
๐Ÿ‡จ๐Ÿ‡ณ ไธญๆ–‡ LoRA ่ฎญ็ปƒๆ•™็จ‹
๐Ÿ‡ฏ๐Ÿ‡ต ๆ—ฅๆœฌ่ชž LoRA ใƒˆใƒฌใƒผใƒ‹ใƒณใ‚ฐใƒใƒฅใƒผใƒˆใƒชใ‚ขใƒซ
๐Ÿ‡ฐ๐Ÿ‡ท ํ•œ๊ตญ์–ด LoRA ํ•™์Šต ํŠœํ† ๋ฆฌ์–ผ

See also the LoRA Training tab in Gradio UI for one-click training, or Gradio Guide - LoRA Training for UI reference.

๐Ÿ”ง Advanced Training with Side-Step โ€” CLI-based training toolkit with corrected timestep sampling, LoKR adapters, VRAM optimization, gradient sensitivity analysis, and more. See the Side-Step documentation.

๐Ÿ—๏ธ Architecture

ACE-Step Framework

๐Ÿฆ Model Zoo

Model Zoo

DiT Models

DiT Model Pre-Training SFT RL CFG Step Refer audio Text2Music Cover Repaint Extract Lego Complete Quality Diversity Fine-Tunability Hugging Face
acestep-v15-base โœ… โŒ โŒ โœ… 50 โœ… โœ… โœ… โœ… โœ… โœ… โœ… Medium High Easy Link
acestep-v15-sft โœ… โœ… โŒ โœ… 50 โœ… โœ… โœ… โœ… โŒ โŒ โŒ High Medium Easy Link
acestep-v15-turbo โœ… โœ… โŒ โŒ 8 โœ… โœ… โœ… โœ… โŒ โŒ โŒ Very High Medium Medium Link

XL (4B) DiT Models

XL models use a larger 4B-parameter DiT decoder (~9GB bf16) for higher audio quality. They require โ‰ฅ12GB VRAM (with offload + quantization) or โ‰ฅ20GB (without offload). All LM models are fully compatible.

DiT Model Pre-Training SFT RL CFG Step Refer audio Text2Music Cover Repaint Extract Lego Complete Quality Diversity Fine-Tunability Hugging Face
acestep-v15-xl-base โœ… โŒ โŒ โœ… 50 โœ… โœ… โœ… โœ… โœ… โœ… โœ… High High Easy Link
acestep-v15-xl-sft โœ… โœ… โŒ โœ… 50 โœ… โœ… โœ… โœ… โŒ โŒ โŒ Very High Medium Easy Link
acestep-v15-xl-turbo โœ… โœ… โŒ โŒ 8 โœ… โœ… โœ… โœ… โŒ โŒ โŒ Very High Medium Medium Link

LM Models

LM Model Pretrain from Pre-Training SFT RL CoT metas Query rewrite Audio Understanding Composition Capability Copy Melody Hugging Face
acestep-5Hz-lm-0.6B Qwen3-0.6B โœ… โœ… โœ… โœ… โœ… Medium Medium Weak โœ…
acestep-5Hz-lm-1.7B Qwen3-1.7B โœ… โœ… โœ… โœ… โœ… Medium Medium Medium โœ…
acestep-5Hz-lm-4B Qwen3-4B โœ… โœ… โœ… โœ… โœ… Strong Strong Strong โœ…

๐Ÿ”ฌ Benchmark

ACE-Step 1.5 includes profile_inference.py, a profiling & benchmarking tool that measures LLM, DiT, and VAE timing across devices and configurations.

python profile_inference.py                        # Single-run profile
python profile_inference.py --mode benchmark       # Configuration matrix

๐Ÿ“– Full guide (all modes, CLI options, output interpretation): English | ไธญๆ–‡

๐Ÿ“œ License & Disclaimer

This project is licensed under MIT

ACE-Step enables original music generation across diverse genres, with applications in creative production, education, and entertainment. While designed to support positive and artistic use cases, we acknowledge potential risks such as unintentional copyright infringement due to stylistic similarity, inappropriate blending of cultural elements, and misuse for generating harmful content. To ensure responsible use, we encourage users to verify the originality of generated works, clearly disclose AI involvement, and obtain appropriate permissions when adapting protected styles or materials. By using ACE-Step, you agree to uphold these principles and respect artistic integrity, cultural diversity, and legal compliance. The authors are not responsible for any misuse of the model, including but not limited to copyright violations, cultural insensitivity, or the generation of harmful content.

๐Ÿ”” Important Notice
The only official website for the ACE-Step project is our GitHub Pages site.
We do not operate any other websites.
๐Ÿšซ Fake domains include but are not limited to: ac**p.com, a**p.org, a***c.org
โš ๏ธ Please be cautious. Do not visit, trust, or make payments on any of those sites.

๐ŸŒ Community & Ecosystem

Check out Awesome ACE-Step โ€” a curated list of community projects, alternative UIs, ComfyUI nodes, cloud deployments, training tools, and more built around ACE-Step.

๐Ÿ™ Acknowledgements

This project is co-led by ACE Studio and StepFun.

๐Ÿ“– Citation

If you find this project useful for your research, please consider citing:

@misc{gong2026acestep,
	title={ACE-Step 1.5: Pushing the Boundaries of Open-Source Music Generation},
	author={Junmin Gong, Yulin Song, Wenxiao Zhao, Sen Wang, Shengyuan Xu, Jing Guo}, 
	howpublished={\url{https://github.com/ace-step/ACE-Step-1.5}},
	year={2026},
	note={GitHub repository}
}

Install ACE-Step on Unraid in a few clicks.

Find ACE-Step in Community Apps on your Unraid server, review the template, and click Install. Unraid handles the Docker app or plugin setup from the published template.

Open the Apps tab on your Unraid server Search Community Apps for ACE-Step Review the template variables and paths Click Install

Requirements

IMPORTANT: This image requires at least 20GB of free space in your Docker vDisk. Check Settings > Docker > Docker vDisk Size and increase if needed. Requires NVIDIA GPU with 8GB+ VRAM (12GB+ recommended for full features). Models (~10GB) are downloaded on first run to the mapped checkpoints volume.

Download Statistics

3,244
Total Downloads

Related apps

Explore more like this

Explore all

Details

Repository
spaceinvaderone/ace-step:latest
Last Updated2026-02-22
First Seen2026-02-22

Runtime arguments

Web UI
http://[IP]:[PORT:7860]/
Network
bridge
Shell
bash
Privileged
false
Extra Params
--gpus all --user root

Template configuration

Web UI PortPorttcp

Gradio Web UI and REST API port

Target
7860
Default
7860
Value
7860
Model CheckpointsPathrw

AI model files (~10GB, auto-downloaded on first run)

Target
/app/checkpoints
Default
/mnt/user/appdata/ace-step/checkpoints
Value
/mnt/user/appdata/ace-step/checkpoints
Generated MusicPathrw

Generated music files output directory

Target
/app/gradio_outputs
Default
/mnt/user/appdata/ace-step/output
Value
/mnt/user/appdata/ace-step/output
DiT ModelVariable{3}

Diffusion model variant. Turbo=8 steps (fast), SFT=50 steps (quality), Base=50 steps (all features including extract/lego/complete).

Target
ACESTEP_CONFIG_PATH
Default
acestep-v15-turbo|acestep-v15-turbo-rl|acestep-v15-sft|acestep-v15-base
Value
acestep-v15-turbo
Language ModelVariable{3}

Chain-of-thought LM size. 1.7B recommended for 16GB VRAM. 4B needs 24GB+. 0.6B for low VRAM.

Target
ACESTEP_LM_MODEL_PATH
Default
acestep-5Hz-lm-1.7B|acestep-5Hz-lm-0.6B|acestep-5Hz-lm-4B
Value
acestep-5Hz-lm-1.7B
Enable LLMVariable{3}

Auto detects based on GPU VRAM. Set false for DiT-only mode (faster, no thinking/sample features).

Target
ACESTEP_INIT_LLM
Default
auto|true|false
Value
auto
LM BackendVariable{3}

pt (PyTorch native) is recommended for RTX 50-series. vllm (nano-vllm) is faster but may segfault on Blackwell GPUs.

Target
ACESTEP_LM_BACKEND
Default
pt|vllm
Value
pt
UI LanguageVariable{3}

Web interface language

Target
LANGUAGE
Default
en|zh|ja
Value
en
CPU OffloadingVariable{3}

auto = ACE-Step decides based on VRAM (offloads below 20GB). false = keep all models on GPU (faster, needs ~12GB idle VRAM). true = offload models to CPU between steps (slower, saves VRAM for shared GPU use).

Target
ACESTEP_OFFLOAD_CPU
Default
auto|false|true
Value
auto
Web UI Port (internal)Variable{3}

Internal port for Gradio server (should match the port mapping above)

Target
PORT
Default
7860
Value
7860
Batch SizeVariable{3}

Default generation batch size (1-8). Leave empty for auto (min(2, GPU max)).

Target
ACESTEP_BATCH_SIZE
CUDA Visible DevicesVariable{3}

Which GPU(s) to use. 0 = first GPU.

Target
CUDA_VISIBLE_DEVICES
Default
0
Value
0
Download SourceVariable{3}

Model download source. Auto tries HuggingFace first, falls back to ModelScope.

Target
ACESTEP_DOWNLOAD_SOURCE
Default
auto|huggingface|modelscope
Value
auto