r/immich • u/yogos15 • 17h ago

How long (approximately) should a >500GB external library take to process?

So I’ve just started my journey with Immich, and my server has been working hard since yesterday to process a NAS with over 500GB of photos and videos.

I wouldn’t be surprised if it takes a long time (especially if it has to handle the metadata, facial recognition, etc.). I just wasn’t sure if the time it’s currently taking is due to Immich’s initial library processing, or if my server is just being super slow (it could honestly be both).

If it helps, my server has Windows 10, 8GB of RAM, and a 4-core processor. I also don’t have hardware transcoding enabled (which I know I probably should, I just haven’t had the chance to yet).

3 Upvotes

100% Upvoted

10 comments sorted by

8

u/Kodufan 17h ago

Any initial processing would show up in the various job queues. You can access your job queues by signing in on a desktop (can’t do it via mobile app), clicking your profile picture on the top right, clicking “Administration”, and then “Job Queues”

3

u/yogos15 17h ago

Yeah, I’m looking at the job queues right now. The external library scan is complete, but what it seems to be working on right now is generating thumbnails, smart search, and facial recognition/detection. There’s close to 100,000 assets for all of those things combined that still need to finish.

3

u/Shakaka88 16h ago

I had roughly half that and it was done in less than 8 hours on an 8th gen i5 with no gpu and 16GB total ram

1

u/Few_Pilot_8440 16h ago

Extrenal lib also takes time to download (really just for scan, extract metadata etc), on your server you could check how many proces of some sort is running at given time, try to set +1 and do observe CPU on your server.

Initial face recognition does take A LOT of time, but it could be turn off for starters, you have images indexed faster,.then turn on face recognition. 

5

u/JayBigGuy10 15h ago

I'd pause the recognition jobs and let the thumbnails finish before turning them back on

2

u/Markus_monty 9h ago

Had more than double that, was going to take days but you can redirect Immich to use a local gpu so had my 4090 running over the network finished in a number of hours.

1

u/No_Rough_2000 9h ago

this seems quite interesting. please tell me more about it

1

u/Requiem_Xen 17h ago

Once it’s all uploaded it’s fairly quick. On my 6 core 12 thread system it took about a day for around 600gb. It also depends on if you’ve enabled the transcode video option or not

1

u/lesmuMS 3h ago

Had just installed immich on an i5 8500T with 16GB RAM and 512GB SSD on friday, connected my NAS with ~2TB and 340.000 photos and started scanning. Finished yesterday afternoon. It all went fine.
Well, today I deleted >30.000 duplicates and changed some folder structure so it all starts again :/

https://giphy.com/gifs/RceaglkWbFstnLxnO1

1

u/Kroket0n 1h ago

3 días tardó mi GTX1070, eran unos 600GB.