nfs copy to usb

From: CHYRON (DSMITHHFX) 1 Sep 2016 21:31
To: ALL1 of 10
So I bought a 'portable' (2.5") 1T external hdd, reformatted it to ext4, exported it, and started copying ~60G from a mac over nfs. The first 6-7G stook 3-hours and the next 11 have taken ~1-hour. It seems a lot slower at copying large numbers of files vs. copying large (-ish) files. Anyway it won't be done and I'll have to resume another day. Thank fuck for cp -Rn.
From: graphitone 1 Sep 2016 22:00
To: CHYRON (DSMITHHFX) 2 of 10
How's it connected; USB2/3, e-sata, thunderboltsandlightning?
From: ANT_THOMAS 1 Sep 2016 22:30
To: CHYRON (DSMITHHFX) 3 of 10
Sounds about right. 1GB of 1MB files takes far far longer than a single 1GB file.

Plus factor in the speed of your network. If you're on 100mbit ethernet then the absolute theoretical max you're going to get is 12.5 MB/s, but more like 10 MB/s.
EDITED: 1 Sep 2016 22:36 by ANT_THOMAS
From: CHYRON (DSMITHHFX) 2 Sep 2016 01:47
To: ANT_THOMAS 4 of 10
GigE. It was hitting ~18MB/s on the bigger files which I figured maxed out USB2 (the hdd is USB3, but I'll need an add-in card for the pc). Most of the files during the slow part were <16 kb (web projects)
EDITED: 2 Sep 2016 01:53 by DSMITHHFX
From: ANT_THOMAS 2 Sep 2016 10:40
To: CHYRON (DSMITHHFX) 5 of 10
Yeah, the tiny files will take an age.

Recently got a USB 3 drive to replace yet another dead internal drive (thankfully managed a full backup before it went totally dead), it was mainly files larger than around 200 MB and the transfer speeds were as if it was an internal drive, very impressed.
From: CHYRON (DSMITHHFX) 2 Sep 2016 11:55
To: ANT_THOMAS 6 of 10
Yeah USB 3 is amazingly fast.
From: koswix 2 Sep 2016 13:58
To: CHYRON (DSMITHHFX) 7 of 10
I used to run a windows install from a USB2 hard drive. It was fine :C
From: CHYRON (DSMITHHFX) 2 Sep 2016 23:16
To: koswix 8 of 10
I've got a USB 2 drive as a network share on the same pc as the portable one I just bought, it's fast enough, but I'm generally not trying to write crazy amounts of tiny files to it at one go.
From: CHYRON (DSMITHHFX) 4 Sep 2016 13:53
To: ALL9 of 10
Plugged in the new external drive to my home pc this morning and it wouldn't mount. I could hear an ominous clicking... Turns out the new-fangled USB 3 drives need more power than a USB 2 port provides (per mfg's web site faq), so I plugged it into a powered hub I happen to have for travel, and it works fine.
From: CHYRON (DSMITHHFX)12 Sep 2016 13:39
To: ALL10 of 10
This morning I was unable to mount the portable drive's nfs share on my mac, so I nfs-mounted the mac source hdd on the ubuntu pc (where the portable is plugged in), and am running the copy from there, hitting >40 MB/s!
EDITED: 12 Sep 2016 13:41 by DSMITHHFX