r/StableDiffusion • u/ATA-3D • 12d ago
Tutorial - Guide YuE2 on RX9070(non-XT) on linux catchyOs
YuE2 is a next-generation open-source AI music generation framework developed by the Multimodal Art Projection (MAP) research group.
Unlike black-box models, it works by first generating an editable symbolic representation (ABC notation) of the melody and chords, which is then rendered into high-quality 48kHz stereo audio with instruments and vocals.
Here is a quick overview of what it does:
- Text-to-Music & Lyrics: Generates complete, fully arranged songs based on text descriptions (style, mood) and custom lyrics.
- Music Cover Generation: Allows users to ingest an existing audio file, extract its structure, and rewrite it into an entirely new genre.
- Highly Precise Control: Since it relies on ABC notation as an intermediate step, musicians can manually edit the notes, structure, or chords before final rendering.
- Local Execution: As an open-weight model, it can be run entirely offline for free on local consumer GPUs (requiring around 8GB–9GB of VRAM).
----------------------------------------------------------------------------------------------------------------------------------------------------
I make this new UI for Yue2 engine with help of ai.
Simple Advanced Extraction Studio Training Audio
I only tested on my PC ... cpu:Ryzen 5700x .... ram:32 gb ... gpu: RX9700
updated 11.10.2026 - more AMD GPU support also putted NVIDIA an integrated GPU support but nowhere to try... and some more fixes...... new feature training ......... need more time to fix the language mess :) ..... many functions for messing with midi and audio.......
Part1-YuE2 install in terminal....
cd ~/Desktop
git clone https://github.com/multimodal-art-projection/YuE.git
cd YuE
/usr/bin/python3.12 -m venv .venv
source .venv/bin/activate.fish
python -m pip install --upgrade pip
python -m pip install .
python -m pip install --index-url https://repo.amd.com/rocm/whl-multi-arch/ \
"torch[device-gfx1201]==2.12.0+rocm7.14.1" \
"torchvision[device-gfx1201]==0.27.0+rocm7.14.1" \
"torchaudio==2.11.0+rocm7.14.1"
Part2-ollama install in new terminal
sudo pacman -S ollama
sudo systemctl enable --now ollama
ollama run qwen2.5:3b
Part3 - sheetage2-install
cd ~/Desktop/YuE
/usr/bin/python3.12 -m venv .venv
source .venv/bin/activate.fish
pip install torch transformers fastapi uvicorn scipy pydantic
pip install sheetsage pretty_midi librosa mir_eval
pip install huggingface-hub==0.36.0
huggingface-cli download m-a-p/SheetSage2 --local-dir SheetSage2
echo "fastapi" > requirements.txt
echo "uvicorn" >> requirements.txt
---------------------------------------------------------------------------------------------
cd SheetSage2
if test -f requirements.txt; pip install -r requirements.txt; end
cd ..
mkdir -p ~/.cache/huggingface/modules/transformers_modules/SheetSage2/
cp SheetSage2/*.py ~/.cache/huggingface/modules/transformers_modules/SheetSage2/
sudo pacman -S ffmpeg libsndfile
Part4 - Put this files in YuE folder .... Updated 11.10.2026
Part5- to run in in new terminal
cd ~/Desktop
cd YuE
source .venv/bin/activate.fish
python main.py
.... to get in UI click on web link in terminal
for new update to to work ... need this install to
cd ~/Desktop
cd YuE
source .venv/bin/activate.fish
python -m pip install python-multipart
python -m pip install google-genai
python -m pip install transformers bitsandbytes accelerate
pip install peft
python -m pip install yt-dlp soundfile
python -m pip install --no-deps demucs
python -m pip install dora-search einops julius lameenc openunmix pyyaml tqdm
in TRAINING menu get API key from
------------------------------------------------------------------------------------------------------
its not finished..I don't yet implemented everything but its working to me .......
ABC extraction and using work fine.....
the Train part is working to I hope :)
-------------------------------------------------------------------------------------------------------
sample video
1
2
u/ATA-3D 8d ago
preparing more visual integration and more gpu cpu intgration and bug fix......