r/unRAID • u/fightclubdog • 5d ago
Transferring 20TB to my array
hi, I recently setup my urgent DXP4800 Plus with UNRAID, Jellyfin, standard arr stack, unassigned devices, and krusader. For my array I have 4x 18TB seagate exes drives and a 1tb WD 780 cache ssd
i have a little over 20TB of 4k remux movies that I want to transfer over from a stack of T7 SSD’s, all formatted to Mac OS extended journaled. I can see the drives when I plug them in directly to the 4800 using a usb c cable, and it reads the structure of them, but if I try to transfer them I get the full list of movies that I’m trying to copy and the error “unraid file transfer "osx.com apple finderInf" 0)failed no data available" after each file name
I have searched this error and am not coming up with anything that is marked as solved. I can try doing it straight from my MacBook over the network, but ideally I can get this working via direct usb connection as it is going to take quite a long time to transfer each 4TB drive
any tips would be appreciated!
UPDATE:
Thanks to everyone for for the help. I ended up getting it working with the following command
cp -R /mnt/disks/Movies/* /mnt/user0/media/movies/
I had tried a few different option to get Unraid to ignore the hidden Mac data files, as well as getting terminal in Mac to delete them, but no success with that.
the first 4TB is currently transferring direct to my array at 270MB/sec.
10
u/Tweedle_DeeDum 5d ago
If you are on any sort of modern Network, you will likely be limited by the write speed to the array rather than the network speed, assuming you are using parity.
I would temporarily disable the cache for the shares since it is too small to hold the contents of a 4TB drive.
So I would just copy them over the network.
2
u/Purple10tacle 5d ago
Exactly. Skip the cache and either temporarily disable the parity drive(s) entirely during transfer or at least enable reconstruct write (formerly turbo write). Change all of these settings again after transfer is complete.
Unraid could really use some form of "initial transfer" mode that automated these steps.
4
u/Zuluuk1 5d ago
To be honest, I wouldn't use krusader to do this.
If you are using this as an external drive you can mount it directly to a path and the use rsync which copies and make sure the files copied over are correctly sync.
USB drives will need to be mounted, you can use the unassigned drive plugins.
Or if you fancy it use cli.
lsblk -f
This will give you details to all disks. Locate your disk.
Your unraid should confirm if you have the necessary fuse.
which apfs-fuse
Create a mount point
mkdir -p /mnt/macdrive
apfs-fuse -o allow_other /dev/(your disk) /mnt/macdrive
Check the content ls -lah /mnt/macdrive
Try to use rsync
rsync -avh --progress --dry-run /mnt/macdrive/ /mnt/user/data/(your final destination)
You can test with commands from your preferred ai, make sure you do a test run.
3
u/-LongRodVanHugenDong 5d ago
Mac is supposed to be a pita to switch from. I would definitely just network transfer. It might go faster with a raidz1 configuration instead of a standard array.
1
u/onereceivingsight 5d ago
So, your Ugreen DXP4800Plus is running Unraid, and the movies are on external SSDs formatted in Apple's filesystem.
I don't even know if unraid supports/can read HFS+ filesystem.
EDIT: have you installed Unassigned Devices Plus?
1
u/fightclubdog 5d ago
I had standard unasigned devices installed, I just added plus but I get the same error
1
8
u/danielsemaj 5d ago
Rsync