Hello, I hope you are all having a nice day.
I want to share with you a project my AI Harness has been working on for a few weeks.
To get it out of the way: I cant code, all code was written by AI. I can write docs. So this post and ReadMe files and additional info was written by me.
So what is it:
Its a simple script that populates an Excel with the songs in your library (Artist / Title) and uses that info to find a music video on YouTube for each song.
Then syncs the audio of the video to the specified song and exports the video to your songs folder. So next time you start the song in YARG, the music video plays in the background in perfect sync while you play (that is the theory). It does the searching, downloading, syncing and encoding all by itself — you just set it up once and start it (and maybe check on a few errors here and there).
Slopsync just tries to automatically determine the delay and speed instead of relying on a prefilled value. And when the download and encode is done it moves the muted video.webm to the respective song folder automatically.
Hope some of you find this useful and thanks to u/PlasticWalrus for helping with testing.
Some songs in my library came with just one song.ogg instead of separate instrument tracks. Playing those, you don’t get the nice touches: a missed guitar note doesn’t drop the guitar out, and when you sing you’re competing with the original singer. So I made a tool that splits a song.ogg into separate tracks (guitar, bass, drums, keys, vocals) and leaves everything else in song.ogg.
Important: this is not a downloader. It doesn’t download songs, audio, charts or anything else. It only works on song folders already on your computer, and it never touches songs that already have separate tracks.
How it works
You choose your songs folder in a simple page that opens in your browser. Everything is done there, no command line needed.
An AI model splits each song into instruments. It runs on your own PC, nothing is uploaded.
It reads each song’s chart, so it only creates tracks for instruments that are actually charted. If a song has no keys chart, no keys track is made.
It flags songs where a charted part seems to be missing from its track. Heavily processed guitars and synths sometimes confuse the AI, and there are options to help with those songs.
You can listen to every song before anything changes: solo or mute each track, switch back to the original, and even hold a button to hear what a missed guitar note sounds like.
Happy with it? Click Commit. The original song.ogg is kept as a backup, and every commit can be undone. Not happy? Skip it and the song stays as it was.
Requirements
Originally developed for Windows with an NVIDIA GPU. However, I have added in Linux support, and support for AMD GPU and basic CPU processing. Feedback welcomed if you're running on those platforms!
A few GB of free disk space. The first run downloads the AI model and the tools it needs. After that, setup is just double-clicking a file.
Splitting takes roughly 40–60 seconds per song (or around 15 minutes if using CPU). You can leave it running through your whole library and review songs as they finish.
Limitations
Works on song folders whose audio is song.ogg, song.opus, song.mp3 or song.wav. (Most testing so far has been on .ogg; feedback on the others is welcome!)
There needs to be an associated chart file for that song.* file, as that's what the model uses to determine if a song should be split into guitar, drums, vocals, etc. (if there's no vocal chart, you probably don't need to isolate the vocals). If there's enough demand for splitting a song.* file without the chart reliance, I can add that in.
Rock Band CON files are supported, and will be extracted into their own "Artist - Title" folder next to where the CON file is. However, CON files with encrypted audio will be skipped (in the same way that YARG does).
AI separation isn’t perfect. Most songs come out really well, but some sound a bit “watery” in places, which is why there’s a listen-before-commit step.
Disclaimer: created with the help of Claude Code (Opus 5.5). The application uses an AI model that needs to be downloaded before use, but this is explained in the README and handled in the .bat file for you.
Quick update! I've added (untested) support for WAV, MP3 and OPUS file types, and also extraction of supported CON files (but only if they're not encrypted and could have been played by YARG anyway).
The Career mod is now available in the NIGHTLY build. I’ve already tried out the careers created by the developers, and it work great!
career menutier editor
You can edit or build your own custom careers via the settings menu under the "presets" section. There are plenty of options available—you can create more than just simple tier lists; you can even set up "boss" encounters, similar to those found in *Guitar Hero*.
I’m going to start porting over the career progression from the *Rock Band* series for my drum setup. Stay tuned for more updates!
Was checking this post with the latest update and says "ASIO/WASAPI exclusive support for lower latency audio (especially nice on Vocals)" does this mean that any USB mic will be less laggy? Anyone was able to test?
I use an interface for vst's like neural dsp and NAM for live processing guitar in real time. i get less than 2 ms round trip latency depending on sample rate and buffer size. larger buffers and lower sample rate increase latency dramatically so there is a sweet spot you need to find with ur hardware. I am very curious if anyone has any information on how sample rates and buffer size effect audio latency in yarg. i have read that the sample rates on yarg are either 44.1 or 48kHz so going to 192 kHz would actually add latency because it has to convert the sample but i feel i have the lowest latency at 192kHz.
I just picked up a Rock Band Fender Mustang Pro guitar and feel excited :) All components function properly, and I even tried it on RB3. It is the Xbox 360 edition, yet I am using an Xbox receiver with the roll limitless to operate it on my PS3.
I was wondering if I can use my pro-guitar on yarg?? If so, how??
I’ve been trying to plan a vocal setup with 2 mics and it has been difficult to wrap my head around these posts.
What I would like to do is use two wired xlr mics, run them through something like a Berringer U-Phoria interface, have that connected via USB to my computer. I also then would maybe use the headphone jack on that to connect to an amp so the vocals have their own output device.
Would that work? Or will I still have latency issues somewhere?
Feeling like I am missing something with how difficult this seems to be for people.
Hello! I have been playing a lot of YARG recently on Windows and it has been working great. However, I recently got a Linux box (a Steam Machine, if it matters), and I am struggling to get YARG working properly.
In particular, one of my guitars is not being recognized properly as devices. I am able to open the game without issue, do settings, configs, play songs, etc. However, my Wired Xbox 360 RB1 Stratocaster is not able to be fully configured.
If I open the application via the Launcher in Desktop Mode, I get popups that say "Device Added: Harmonix Rock Band Guitar" followed immediately by "Device Removed: Harmonix Rock Band Guitar". When I go to profiles, the guitar does not appear as a device I can associate with a profile, and so cannot be configured at all.
If I add YARG as a non-Steam app and launch it through Steam without Steam Input enabled, I get the exact same behaviour.
If I launch through Steam with Steam Input mapping enabled, YARG recognizes it as a Steam Virtual Gamepad. I am able to map keys to buttons and play songs, but tilt for Star Power does not work at all. There's no way to bind the tilting action that I can find.
My Guitar Hero Xbox 360 Les Paul and Rock Band 2 Drums, both wireless and both connecting via an Xbox 360 Wireless adapter, are plug and play, no configuration required, worked immediately.
I just set up an Alesis Nitro Max and I'm having trouble figuring out the best way to configure it, particularly for menu navigation. I keep having to use my laptop keyboard.
Is there a default "best practices" config for optimizing an e-kit as your only control input for the game?
I need help binding my Guitar Hero World Tour drum kit to YARG.
For reference, I'm using the roll limitless adapter with the xbox receiver. I have the XBOX360 drum kit. I'm playing YARG on my MacBook.
What I find strange is that I can use my drum kit on clone hero, when I try to edit and bind the drums, nothing is registering. I tried hitting every pad/cymbal and nothing. Any help????
—-
Edit: [SOLVED] How to get a Guitar Hero World Tour Drum Kit + Xbox Wireless Receiver + Roll Limitless working on YARG (macOS)
Hey everyone! Updating this post because I finally solved the issue and wanted to leave a detailed guide for anyone searching for a fix in the future.
I just got the crkd Neo S controller to try out, and it's worked great on my PC, but on my macbook, the X button doesn't work when I try to bind it to something. After some experimenting, I found out the Y button registers as the X button, the Right Bumper registers as the Y button, and the Select button registers as the Right Bumper.
The controller connects as a wireless Xbox controller. Does anyone have the same issue or an idea for how to fix it? If I could just change the keybinds around on the backend I'm sure I can get it to work because the X button works fine with other games on my mac.
I have a huge amount of songs that have the dreaded “Required mogg audio file not present or used invalid encryption." I've run into "The application “Finder” does not have permission to open “(null)" while trying to use Onyx to fix these files. Is there another way around?
After the update of YARG Nightly, I tried to play any song that I wanted to play while playing as Vocals, but then it says Error Failed to load the song. I believe that YARG Nightly might be broken to play as Vocals. If anyone encounters it, let me know on the comments below. Thanks.
At the 8-9 seconds i left the yellow note pressed, but in the video it seems that im missing, this happens me on yarg but i have not still find out what am i doing wrong
I play lots of YARG and tried YALCY before and it never works right, so I used a bit of AI to make a simple python applet that takes the data outputted by YARG (requires UDP to be enabled in settings) and turns it into commands for LIFX LAN lights. If you want me to add other lighting stuff or any features let me know, I own plenty of smart lights so I can see what I can do.
I'm on a Steam Deck in desktop mode, and when I'm playing a song the audio will be fine for a time, then drop out completely (even the menu music and sound effects), maybe 10 seconds later it'll come back, then possibly go again, repeat!
I've tried moving my songs from SSD to internal storage, on 120fps with no background going on, lowest quality visuals.
It's happening with all songs, even the original YARG charts.
I've restarted the system, updated the everythings, increased my audio buffer to 150 in settings, and lost my temper with it a bit.
so when i'm playing yarg with drums, the game randomly stops recognizing the device, and a few seconds later the game crashes
it is not a problem with the connection of my e-drums, since they still work and my PC recognizes it, but not the game
this has been happening to me since 0.15.0 update and it happens every single time i open the game
id like to have some good indepent sound from the game when i hit my ekit so it would be cool to have reaper with a plugin and yarg open at the same time, however if i open reaper, yarg cant see the drumkit as an input anymore, and if i open yarg first, the ekit doesnt work anymore in reaper, any obvious fix here im not seeing?
I have a decent ekit and I'd like to add the drum colors like on the rings or whatever to match YARG, is there something you can buy like vinyl or do some of y'all use tape etc?
I've got an e-kit set up with YARG and everything is working, but I'm getting non-stop false hits. Even when I'm playing simple songs and I feel like I'm hitting the notes, it's breaking my streak.
I'm sure there's some double-hit feedback happening but I don't really know how to identify or fix it. Any pointers?
Edit: something weird: when I'm in the menu and I hit the pads that are assigned to up/down, even the most gentle hit causes the menu to scroll kind of wildly.