My FTP upload (to OMV) speed was also really slow sometimes, usually if any sort of other disk activity was going on. and this was on a Xeon. After running slow for a long while, it would often get faster. (closer to ethernet speed).
I didn't ever come to a resolution.