That's because it's here
Thanks. Tha was fast! But maybe there should be a redirect?
Beiträge von AlessBoe
-
-
I can't reach https://www.omv-extras.org. It just says timeout. Is there anyone here maintaining the site?
Thanks
Aless
-
I got an used laptop with a core i5 and installed a fresh omv. now i'm getting about double the speed.
It just seems the combination of mounting a passwort protected cifs with a ntfs filesystem + writing to a usb ntfs + rsync is not an ideal combination and uses lots of cpu power. I guess there was nothing wrong with the pi after all. It's just my weird setup. By changing the setup or the filesystem i could probably get additional speed. But due to other reasons this is not an option for me. Today i'm already happy with double the speed.
Thank you for the support and all the answers adoby! -
I attached two screenshots. one from htop: looks like ntfs mount takes up quite a bit of cpu usage.
one from bmon with the network statistic -
Jup sorry should both be MB/s
-
Just run a couple of tests. copying from ext4 usb 3.0 to etx4 usb 3.0 file system gets speeds of about 110 Mb/s. then used the same devices formated as ntfs: 30 MB/s speeds. So i guess the filesystem is (also) a problem. Linux still doesn't like ntfs, right?
openmediavault uses ntfs-3g to mount ntfs filesystems. any ideas how i can improve the performance -
Ok. I'm back. I did the following: I found a second usb 3.0 device that is the same type as the one i have been using for all the test above. I connected it to the USB 3.0 port of the rasp4. so we have 2 x usb 3.0 hard drives on the rasp4. then i copied a 2,46 gb file from one device to the next with 'time cp': 1 min 30 sec. so thats definetly not USB 3.0 speed. I ll try a differnt USB device. It seems like that could be the problem.
-
Ok, i will try that in the next days (when i find time) and post the results.
-
just copyied a 2950 MB file using cp from the NAS to the USB hard drive in 4 minutes and 30 sec (real: 4min 30sec, user 0, sys 26 sek). Thats really slow. It's just over 10,9 MB/s.
That makes me think rsync is not the problem.
Thanks for the wikipedia link. I don't think the external USB device is the problem here. I used that same USB HDD on my windows machine and achieved speeds way over 100 MB/s. e.g. NAS -- via Gigabit Eternert -- Windows Laptop -- on USB 3 port -- USB 3.0 HDD.
Now the setup is NAS -- Gigabit Ethernet -- rasperry pi 4 b -- USB 3 port -- USB 3.0 HDD. In this setup i somehow loose the speed yet i don't know why. Any other ideas?
(running htop i checked CPU is at around 33%. Most of that ist the mount command. the cp only makes up for around 5-7%)
-
Any idea how i can test the general copy speed without using rsync? Just to make sure that rsync is the bottel neck. Just copy a large file using cp command from the NAS (which btw is a drobo 5N, not a OMV) to the USB hard drive connected directly to the pi.
or is there a better quick and easy way?
-
Jup please let me know
-
Alles anzeigen
Rsync can be pretty slow copying files. Especially if it is many small files. But it also may depend on the direction and the filesystems used. Faster when using SATA, NFS and ext4 than SMB, NTFS, USB and/or SSH. In my experience it also seems that rsync is a little faster pulling data than pushing data.
Pulling means you run rsync on the destination server, not on the source server. It might be better cache usage?
It may also be possible to speed up rsync by running rsync using the rsync daemon and bypass network filesystems completely. Also you might speed up rsync by turning off some features and checksum stuff and/or running it on a more powerful server.
But still rsync will be slower than plain metal to the metal filecopying.
The benefit of using rsync becomes more apparent when you update the files later. Then only changed/added files need updating.
Thanks for the quick reply. You really think rsync/the server is the bottle neck in this case? Interessting...
rsync is running on the rasp. so i'm pulling the data from the NAS. So that won't help. The NAS has a NTFS file system (can't change that.) The USB hard disk is plugged into the rasp. and is also NTFS (can't change that, since windows needs to read that filesystem as well)
In this case i can't bypass the network file systems. Which features do you recommend to turn off to speed up the process?
-
-
Hello everyone,
i installed this image (https://sourceforge.net/projec…/Raspberry%20Pi%20images/) on my raspberry pi 4b. I set up an rsyncjob using the GUI to copy files from a NAS (cifs) to a USB drive connected to the USB 3.0 port of the raspberry pi.
When copying files I realised the speed is only around 20 MB/s.However if i connect the USB drive to my windows machine and copy from the same NAS i get speeds of around 110MB/s.
Should the raspberry pi 4b not be able to achive something around at least 80 MB/s? It is connected via ethernet to the NAS.
USB drive has its own power supply.(i m a newbie. If you need more information i can provide it. Please provide detailed explanation how to get it)
Thanks for any help!
