RSync quit after 40 minutes

    • RSync quit after 40 minutes

      I am trying to copy an EXT4 disk to a Ntfs disk both external since I got a PI, it is working fine but every 40 minutes it stops and I have to reboot.

      Source Code

      1. Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C; export SHELL=/bin/sh; sudo --shell --non-interactive -- /var/lib/openmediavault/cron.d/rsync-22370960-3bac-4b84-be9c-5cfcb707a2e2 2>&1' with exit code '1':
      2. Error #0:
      3. OMV\ExecException: Failed to execute command 'export PATH=/bin:/sbin:/usr/bin:/usr/sbin:/usr/local/bin:/usr/local/sbin; export LANG=C; export SHELL=/bin/sh; sudo --shell --non-interactive -- /var/lib/openmediavault/cron.d/rsync-22370960-3bac-4b84-be9c-5cfcb707a2e2 2>&1' with exit code '1': in /usr/share/openmediavault/engined/rpc/rsync.inc:261
      4. Stack trace:
      5. #0 /usr/share/php/openmediavault/rpc/serviceabstract.inc(565): OMVRpcServiceRsync->{closure}('/tmp/bgstatuser...', '/tmp/bgoutputff...')
      6. #1 /usr/share/openmediavault/engined/rpc/rsync.inc(265): OMV\Rpc\ServiceAbstract->execBgProc(Object(Closure))
      7. #2 [internal function]: OMVRpcServiceRsync->execute(Array, Array)
      8. #3 /usr/share/php/openmediavault/rpc/serviceabstract.inc(123): call_user_func_array(Array, Array)
      9. #4 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod('execute', Array, Array)
      10. #5 /usr/sbin/omv-engined(536): OMV\Rpc\Rpc::call('Rsync', 'execute', Array, Array, 1)
      11. #6 {main}
      Display All

      The post was edited 1 time, last by Nefertiti ().

    • Sometimes (but admittedly rarely) it is a Bad Idea™ to copy stuff from EXT4 to NTFS.
      The differences in case sensitivity may in some special cases lead to a corrupt transfer, data loss and other errors.

      What happens when you try to just copy the files using the command line? Or when you run rsync with verbose flags?
      Try a verbose rsync dry run and see if something stands out.

      Other ideas to try to figure it out:

      Check the disks for errors.
      Check the timing, is it exactly 40 minutes every time?
      Is something else happening after 40 minutes, when idle? Check logs.
      Try the same transfer but with both disk as EXT4 or NTFS.
      Try a small rsync job between the disks, even several.
      Try to find if there are some specific files/folders that seems to cause errors.
      Try to throttle rsync and see if that helps.
      Try cleaning the contacts.
      Try with different cables.
      Is something running hot? Try cooling with a fan.
      Try with different (bigger) power supplies.
      Try with better cooling.
      Try with another computer.
      OMV 4, 7 x ODROID HC2, 1 x ODROID HC1, 3 x 12TB, 2 x 8TB, 1 x 4TB, 1 x 2TB SSHD, 1 x 500GB SSD, GbE, WiFi mesh
    • Adoby wrote:

      Sometimes (but admittedly rarely) it is a Bad Idea™ to copy stuff from EXT4 to NTFS.
      The differences in case sensitivity may in some special cases lead to a corrupt transfer, data loss and other errors.

      What happens when you try to just copy the files using the command line? Or when you run rsync with verbose flags?
      Try a verbose rsync dry run and see if something stands out.

      Other ideas to try to figure it out:

      Check the disks for errors.
      Check the timing, is it exactly 40 minutes every time?
      Is something else happening after 40 minutes, when idle? Check logs.
      Try the same transfer but with both disk as EXT4 or NTFS.
      Try a small rsync job between the disks, even several.
      Try to find if there are some specific files/folders that seems to cause errors.
      Try to throttle rsync and see if that helps.
      Try cleaning the contacts.
      Try with different cables.
      Is something running hot? Try cooling with a fan.
      Try with different (bigger) power supplies.
      Try with better cooling.
      Try with another computer.
      Everything was under a fan temp 47 I am going to go use smb
      from my computer but I am kind of scare since an other PI completely died on me doing this but no fan at this time. I am in a hurry so if i get an error again will check the disk
      I do not know how throttle RSync neither the exact command line for copy my folders without starting all over again.
    • I do this Rsync job the execute Rsync job windows freeze after a while I cannot say the exact time, so I push stop, I am able to click run again Nothing happen in the execute Rsync job so if I reboot very often I am losing the web GUI the green LED flash every second like a beacon and that it my only option is to use a backup for the SD since I do not get a web gui.
      Even If I reboot without tempting to stop the execute Rsync job windows no more web gui

      Update singe I just got a keyboard was able to login as root although the screen was in emergency mode and I use OMV-firstaid option 2 was able to reboot but do not know what is going on with Rsync?
      Files
      • syslog.zip

        (41.03 kB, downloaded 49 times, last: )
    • No idea what is going on, but it seems seriously borked.

      Suggestion: Don't use RPI and OMV. It is obviously not working.

      Connect the disks to a normal PC and copy the files over. If needed after booting the PC to Linux using a thumb drive. If needed after removing the disks from the USB-case and connecting using SATA.
      OMV 4, 7 x ODROID HC2, 1 x ODROID HC1, 3 x 12TB, 2 x 8TB, 1 x 4TB, 1 x 2TB SSHD, 1 x 500GB SSD, GbE, WiFi mesh
    • Adoby wrote:

      No idea what is going on, but it seems seriously borked.

      Suggestion: Don't use RPI and OMV. It is obviously not working.

      Connect the disks to a normal PC and copy the files over. If needed after booting the PC to Linux using a thumb drive. If needed after removing the disks from the USB-case and connecting using SATA.
      Not a problem this card was an an installation upgrade from 3.9 I should get very soon a rockpro in the meantime since finally today I was able get a gui from a fresh install I am going to make a new install