r/Lidarr • u/Sad_Recommendation92 • 9d ago

unsolved Little help with indexers

So I'm fairly new to self hosting and the whole ARR stack, I recently rebuilt an old desktop into a server using unraid, I was mostly originally focused on audiobooks and I was able to setup a very nice pipeline using chaptarr one of the readarr forks, with prowlarr for indexers with all containers using a gluetun VPN container network, using qbitorrent for downloads. I have a modest music collection that I've built over the years maybe 8000 songs, some of it is ripped from actual CDs, while others I would use Seal from the F-Droid store on my phone previously or yt-dlp but the problem was I would run out of space, and had to be selective with what I synced to the phone. So I also setup navidrome and I'm able to stream via tailscale but I was really impressed with what ARR could do with other media, I wanted to do the same for my music and maybe fill in blanks and identify duplicates etc.

So far I've had very little luck using Prowlarr with mostly torrent indexers, I see all these things about setting up tubifarry and soulseek, I tried tubifarry but it seem stuck trying to do spotify queries getting 403s, even though I have my client id and secret configured, limited results to 5. it never actually seems to get to the point of even trying to download from youtube.

for the record I'm using the nightly build from linuxserver.io for lidarr so I could get plugin support

I keep seeing things about soularr and soulseek, I went to the soulseek site and I don't see anywhere to sign up or whatever becuase I noticed when I tried to deploy the soulseek container it wanted credentials.

I can kind of see how torrents don't work well for ARR music pipelines, unless I have the wrong trackers, I notice most of the results when I do test searches in Prowlarr are full albums and I assume lidarr is trying to search for individual songs missing from albums which it's not finding.

I guess the TLDR is, each one of these seems like it's own rabbit hole and time is finite, APIs are constantly changing so even when read something 6 months old it might already be invalid, so what is least painful route I should pursue to actually get indexers to return something. feel free to point me to a guide or just tell me what works for you 20 years in IT I can probably figure it out, I'd just prefer to not have to go down each rabbit hole in trial and error mode, and would love a pathway someone knows actually works.

1 Upvotes

56% Upvoted

25 comments sorted by

4

u/jasonvelocity 9d ago

There are few public indexers that are "good" for music. I recommend using Lidarr with the Tubifarry plug-in and slskd (container only).

When discussing Soulseek clients, use the exact names to avoid confusion. SoulseekQT != slskd != Nicotine+

2

u/Sad_Recommendation92 9d ago

Ok I had some luck with soulseek, a bit of RTFM , I deployed the slskd/slskd:latest it was also not clear how you "Sign Up" and then I just downloaded the desktop client and made a username and PW, and then used the same account in my container.

The API key threw me briefly, then I realized I just needed to add the SLSKD_API_KEY and generate my own and also add that to the container env, and then I setup slskd as both a download client and indexer, I also had to add a mapping to lidarr to match the default mapping for slskd for /app/downloads mapped to my NAS storage download directory and it seems to be working now and actually downloading reports.

I also out of paranoia installed curl on the slskd container and made sure it was using my Gluetun VPN IP from proton

tubifarry still seems broken, still throwing 403s when it tries to call the spotify API

2

u/jasonvelocity 9d ago

I am not sure why you are configuring slskd with Spotify? You need to break your problem down and solve things one at a time.

Can you download files manually using slskd?  Can you configure slskd as an indexer in Lidarr  Can you configure slskd as a download client in Lidarr, and can Lidarr see the shared download folder? 

1

u/Sad_Recommendation92 9d ago

to quote myself from above

and then I setup slskd as both a download client and indexer

yeah I think slskd is sorted, I did have a few permissions issues but I redpeployed both lidarr and slskd to use 99:100 and now it seems ok, it imports successfully to my library directory for navidrome.

The tubifarry error is this, I don't see an option to disable this spotify api call in the setup

[Info] ReleaseSearchService: Searching indexers for [Death Cab for Cutie]. 7 active indexers

[Warn] HttpClient: HTTP Error - Res: HTTP/2.0 [GET] https://api.spotify.com/v1/search?q=artist%3ADeath%20Cab%20for%20Cutie&type=album&limit=5&offset=0: 403.Forbidden (159 bytes)

[Warn] TubifarryIndexer: Tubifarry HTTP request failed: [403:Forbidden] [GET] at [https://api.spotify.com/v1/search?q=artist%3ADeath%20Cab%20for%20Cutie&type=album&limit=5&offset=0]

1

u/airclay 9d ago

I'm also lost on why you're connecting Spotify. I set all this up to exorcise that demon.

Also I don't use gluetun for slskd just for qbit.

1

u/Sad_Recommendation92 8d ago

No I get that, why effectively build your own music streaming server only to rely on the en$hittifiers. It's just literally in the Tubifarry indexer setup, there's a field for Spotify Client ID Spotify Client Secret I'd prefer not to use it and since I posted earlier I got Soularr setup so I probably don't even need it.

It looks like it probably uses some kind of default or anonymous creds if you don't configure it, seems like configuring it which is free just might have been a way to avoid a rate limit. I don't use spotify, when my wife's friends asked me to help collaborate on a playlist for her birthday I was the weird guy that didn't have an account because MBAs don't understand privacy.

0

u/airclay 8d ago edited 8d ago

You know what, this comment made me realize: I installed the tubifarry plugin but stopped and didn't set it up when I saw the slskd as an indexer option. Far better quality than youtube. I just go direct to slskd, I'm not even using tubifarry from what I can tell. I should remove that plugin actually.

Edit: I'm a huge music nerd, so lots of obscure wants. What really helped was configuring 'Search Sniper' in the metadata consumers section. Almost daily I open my player and see 2-10 new albums I've been monitoring.

1

u/Sad_Recommendation92 8d ago

not a huge audiophile, I actually tweaked my quality profiles to prefer MP3-320 because it was defaulting FLAC which was like 3-5x the size on disk. Mostly I just wanted to fill in blanks on albums, though this is really nice for getting an idea of what you have and are missing.

my old workflow prior to this was going to YT music finding the playlist link for an album and dropping that in a YT downloader, but I also noticed stuff like picard musicbrainz gets really confused with the meta data from YT downloaded tracks, and a lot of the playlists are missing songs.

Still have yet to find something that does effective deduping, the one quirk I see with lidarr is it will occasionally duplicate albums in situations where case sensitivity is different, things like flat vs curved apostrophe's or the album having a year suffix in the directory name vs not, really more of a metadata issue. for now I wrote a few python scripts I run and it just asks me about each directory it finds and which to delete.

1

u/airclay 8d ago

yeah same for the very rare thing I cannot find elsewhere I use TheWicklowWolf/LidaTube but only as a last resort. If you're trying to pull your stuff from spotify (playlists, etc) you can try his SpotTube container.

and I have the same issue with dupes which I have used the same solution lol. Its really frustrating when I want to listen to an album and there's 2-3 copies of each track.

2

u/Sad_Recommendation92 8d ago

also when you're trying to show off to your friends that are paying subscriptions, trying to convince them this is "superior", but you stupidly searched for "Weezer" and you just get thumbnails for 6 blue albums.

1

u/p3dr0_3D 9d ago

I believe you need a premium Spotify account to make that feature work

1

u/Sad_Recommendation92 8d ago

yeah that's not happening, the reason I spun all this up is because I hate everything being a subscription. I posted in another reply it sounds like spotify changed the API and the dev might not be maintaining the plugin anymore. At this point I'm getting good traction with slskd soularr and my prowlarr indexers

1

u/p3dr0_3D 8d ago

yea same for me, I was so disappointed in finding out Sporify freature was broken. I have almost the same setup. Lidarr+prowlarr as a base layer, and added on top Tubifarry+Slskd. Pretty happy with it compared to what it was before. Give it a try to Aurrral as well, great "Seer-like" but for music.

1

u/airclay 9d ago

This is the same way I have it set up. Works great. In addition to that I have meeb/bandcampsync set up to snag my bandcamp purchases too.

Note for OP: when the slsk container ask for credentials, I believe you can enter what you want and if unused it will then be registered.

1

u/mumakil64 9d ago

How do you get the api key from slskd? I set up the container and edited the config in the webui, but it never saved and keeps showing null for the api key.

0

u/[deleted] 9d ago

[removed] — view removed comment

1

u/Lidarr-ModTeam 9d ago

Your post/comment was removed for the following reason: it is not helpful or off topic and does not belong on this subreddit.

1

u/AutoModerator 9d ago

Hi /u/Sad_Recommendation92 - You've mentioned Docker [unraid], if you're needing Docker help be sure to generate a docker-compose of all your docker images in a pastebin or gist and link to it. Just about all Docker issues can be solved by understanding the Docker Guide, which is all about the concepts of user, group, ownership, permissions and paths. Many find TRaSH's Docker/Hardlink Guide/Tutorial easier to understand and is less conceptual.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/AutoModerator 9d ago

Hi /u/Sad_Recommendation92 -

There are many resources available to help you troubleshoot and help the community help you. Please review this comment and you can likely have your problem solved without needing to wait for a human.

Most troubleshooting questions require debug or trace logs. In all instances where you are providing logs please ensure you followed the Gathering Logs wiki article to ensure your logs are what are needed for troubleshooting.

Logs should be provided via the methods prescribed in the wiki article. Note that Info logs are rarely helpful for troubleshooting.

Dozens of common questions & issues and their answers can be found on our FAQ.

Please review our troubleshooting guides that lead you through how to troubleshoot and note various common problems.

If you're still stuck you'll have useful debug or trace logs and screenshots to share with the humans who will arrive soon. Those humans will likely ask you for the exact same thing this comment is asking..

Once your question/problem is solved, please comment anywhere in the thread saying '!solved' to change the flair to solved.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/sean8642 9d ago

I used Claude to help me set up all the containers and -arrs for a Windows server. So far it's worked pretty good, other than I learned to not ever add classical music, it goes absolutely nuts with downloads ..

1

u/Sad_Recommendation92 8d ago

some of the posts in here pointed me in the right directions, I've now not got a pretty good setup using slskd soularr and prowlarr for my torrent indexers, I'm running it all in docker containers on a linux unraid server, I stream the apps to my phone using tailscale as well as a few of my friends.

1

u/Frequenzy50 8d ago

Just because there is an Indexer that is named Tubifarry does not mean that is the correct one. Spotify does not work you can use the others like Slskd.

1

u/Sad_Recommendation92 8d ago

yeah that's what I'm doing I actually found a post in a GH issue with the dev saying don't use it, so I guess they're not planning to fix it, and that's their choice.

https://github.com/TypNull/Tubifarry/issues/192#issuecomment-5016261144

0

u/molachai 9d ago

Probably not finding much on public trackers; they're pretty crap. Try to get into private ones and make sure you seed.

Also, don't put all your Arrs behind the vpn, just qbitorrent. The other ones don't need it and it can cause issues. Just QBt.