Rsync from Qnaps Server to a Raspberry OMV

    • OMV 2.x

    This site uses cookies. By continuing to browse this site, you are agreeing to our Cookie Policy.

    • Rsync from Qnaps Server to a Raspberry OMV

      I know that this is not a QNAPS fourm, but I think the problem I am having resides on the OMV, and I hope that someone can assist me in finding and resolving this issue.

      Source NAS
      Qnas TS-469 Pro

      destination
      OMV Version 2.2.5

      Ok I am trying to set up a Rsync / backup from my Qnaps NAS to a Destination Server ( OMV )

      I have created the shares on my OMV with no issues, and I have tested that I have access to the folders from a windows platform,
      by dragging and dropping a few files over to the omv share.


      Now that I am happy that all is working, I would like to set up a schedule backup of all my data from my Qnas to my OMV.
      but when I started to create the jobs on the QNAPS server , I ran into a little problem.

      I have enter in the settings for the OMV server and check the connection, and it is reporting back successful,
      I then choose the Source folder which I want to be backup, but when I choose the destination folder, the options for this is is blank.

      http://pixady.com/image/pfp/

      is there something I am missing on the OMV server that will allow the QNAPS to search / index the folder structure ?
    • It's probably a permissions issue. If you set permissions to allow Guests to "write", on the OMV side, Qnas should be able to "push" to the OMV share. (But that's risky if your LAN has open ports to the world. Further, I doubt you'll be able to find much help with Qnas on this forum.)
      _____________________________________________

      Why not pull the directory from Qnas to OMV, using Rsync on the OMV server?

      I setup a user named "backup", on a windows server, that has read only access to shared directories I wanted to back up to OMV. From there I used the remote mount plugin (in your case, using OMV 2.2.5, it would be the "remote share" plugin), specified the user name "backup" and password, to mount the remote share. (To OMV, the remote share now looks like it's local.)

      I created a local shared folder on OMV, as a destination directory, and set up a local Rsync job. The source for the Rsync job is the remote share (in your case on Qnas) the destination is the local shared folder on OMV.

      I'm backing up 10 network shares, in this manner. All is working well.
      Good backup takes the "drama" out of computing
      ____________________________________
      OMV 3.0.90 Erasmus
      ThinkServer TS140, 12GB ECC / 32GB USB3.0
      4TB SG+4TB TS ZFS mirror/ 3TB TS

      OMV 3.0.81 Erasmus - Rsync'ed Backup Server
      R-PI 2 $29 / 16GB SD Card $8 / Real Time Clock $1.86
      4TB WD My Passport $119
    • Hi Flmaxey

      thanks for you help and procedure on how to get this to work. but I have ran into a little issue.
      when I go and install the plugin " Openmediavault-remoteshare 1.1" I am informed the following


      Building dependency tree...
      Reading state information...
      The following packages were automatically installed and are no longer required:
      libck-connector0 libexif12 libgphoto2-2 libgphoto2-l10n libgphoto2-port0
      libgusb2 libieee1284-3 libpam-ck-connector libpolkit-agent-1-0
      libpolkit-backend-1-0 libsane libsane-common libsane-extras
      libsane-extras-common sane-utils
      Use 'apt-get autoremove' to remove them.
      The following extra packages will be installed:
      cifs-utils curlftpfs davfs2 fuse-utils glusterfs-client glusterfs-common
      libibverbs1 libneon27-gnutls sshfs
      Suggested packages:
      smbclient glusterfs-examples
      Recommended packages:
      keyutils winbind
      The following NEW packages will be installed:
      cifs-utils curlftpfs davfs2 fuse-utils glusterfs-client glusterfs-common
      libibverbs1 libneon27-gnutls openmediavault-remoteshare sshfs
      0 upgraded, 10 newly installed, 0 to remove and 82 not upgraded.
      Need to get 10.3 MB of archives.
      After this operation, 26.0 MB of additional disk space will be used.
      WARNING: The following packages cannot be authenticated!
      cifs-utils curlftpfs fuse-utils libibverbs1 glusterfs-common
      glusterfs-client libneon27-gnutls davfs2 sshfs openmediavault-remoteshare
      Authentication warning overridden.
      Err packages.omv-extras.org/debian/ stoneburner/main openmediavault-remoteshare all 1.1
      Something wicked happened resolving 'packages.omv-extras.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main cifs-utils armhf 2:5.5-1
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main curlftpfs armhf 0.9.2-5
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main fuse-utils all 2.9.0-2+deb7u2
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main libibverbs1 armhf 1.1.6-1
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main glusterfs-common armhf 3.2.7-3+deb7u1
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main glusterfs-client armhf 3.2.7-3+deb7u1
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main libneon27-gnutls armhf 0.29.6-3
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main davfs2 armhf 1.4.6-1.1+wheezy1
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Err mirrordirector.raspbian.org/raspbian/ wheezy/main sshfs armhf 2.4-1
      Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…ifs-utils_5.5-1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…rlftpfs_0.9.2-5_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…ls_2.9.0-2+deb7u2_all.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…bverbs1_1.1.6-1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…_3.2.7-3+deb7u1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…_3.2.7-3+deb7u1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…gnutls_0.29.6-3_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…4.6-1.1+wheezy1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch mirrordirector.raspbian.org/ra…use/sshfs_2.4-1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
      Failed to fetch packages.omv-extras.org/debian…t-remoteshare_1.1_all.deb Something wicked happened resolving 'packages.omv-extras.org:http' (-5 - No address associated with hostname)
      Unable to correct missing packages.
      E: Aborting install.
      <<< *************************************

      is this due to the fact the version I am using is no longer supported ?
    • chrischambers wrote:

      is this due to the fact the version I am using is no longer supported ?
      Nope, you need to set your dns server in network settings.
      omv 4.0.11 arrakis | 64 bit | 4.13 backports kernel | omvextrasorg 4.1.0
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please don't PM for support... Too many PMs!
    • Try using 8.8.8.8. That's google's DNS. It's a big well funded outfit so their server always up.
      Good backup takes the "drama" out of computing
      ____________________________________
      OMV 3.0.90 Erasmus
      ThinkServer TS140, 12GB ECC / 32GB USB3.0
      4TB SG+4TB TS ZFS mirror/ 3TB TS

      OMV 3.0.81 Erasmus - Rsync'ed Backup Server
      R-PI 2 $29 / 16GB SD Card $8 / Real Time Clock $1.86
      4TB WD My Passport $119
    • I can't believe I forgot the DNS. My Bat

      ok, I have a new question,

      after I have resolved my "School Boy Error" and installed the Plugin,
      I then created a new share on my OMV called "NAS" with Administrators to have full access and users with read only
      next I click on the Remote Shares and started to create a new mounted share to my NAS

      here is the information I have enter

      server 192.168.0.7 (This is the IP Address is the NAS)
      Export ??
      Shared Folder thenas (This is the new share I am trying to mount the NAS to)
      NFSv4 - Disable
      Extra Options intr

      can you please inform me on what I need to enter into the Export box, and also if I am filling in the information right.
    • The following is (roughly) the drill. **Note I'm using "remote mount" (OMV 3.0.68) where you're using "remote share" (OMV 2.2.5), so your plugin will look different. The remote shares I'm mounting are Samba / Windows shares.

      This is the first step. This allows OMV to treat the remote share as a local directory.



      Second is setting local shares. You need two. The first one is truly local. The other is a reference to the remote directory, above.
      **In the following, when you set up the remote share, OMV may try to set permissions on the remote. But, if you set up a read only user on your remote NAS (highly recommended) the permissions change won't be allowed. This may create an error. Ignore it.**



      The following is the detail of setting up the remote directory as a local share. Name it anything you like. (I identified my remote directories with _R to keep them straight) The second drop down is the remote share itself. Note "/" means the "root" of the remote share. (By default, the dialog window may enter something like "/Backups_R") If anything is added here that is not a sub-directory in the remote, it won't work. If you want to Sync everything on the remote share, "/" should be entered here.



      Finally, set up you Rsync Job. (Don't turn on "Quiet", "suppress non error warning messages". If you do, you won't see file progress when manually triggering a job. At first, that had me believing something was wrong.)
      Note that the source is the remote and the destination is local.



      More detail. Make sure to use / turn on "Keep partially transferred files". This can be important in large sync jobs.



      Let me know how it goes.
      Good backup takes the "drama" out of computing
      ____________________________________
      OMV 3.0.90 Erasmus
      ThinkServer TS140, 12GB ECC / 32GB USB3.0
      4TB SG+4TB TS ZFS mirror/ 3TB TS

      OMV 3.0.81 Erasmus - Rsync'ed Backup Server
      R-PI 2 $29 / 16GB SD Card $8 / Real Time Clock $1.86
      4TB WD My Passport $119
    • ok, I am still having issues, and I have decided to bin the old version and install the version 3.0.72
      I have ran and install all the updates that it listed,

      I then tried to locate and install the remote mount, so that I am follow your steps, but I am not able to locate it in the plugs.
      I have gone in and check the community maintained updates, but still no option to install.

      can you please advice on where to find this plugin.
    • (I use a Raspberry PI so the OMVExtras plugin is available by default. When I started a standard build, I was surprised to the learn the following.)
      _____________________________________________

      SInce you're using the installer versions of OMV, you'll have to down load the file found here. ->


      **For OMV 3.x (erasmus)
      - omv-extras.org/openmediavault-omvextrasorg_latest_all3.deb

      (Put it on your desktop.)
      From the web GUI, in the <SYSTEM>, <PLUGINS> window, click on "Upload". Browse to the file downloaded file and click on OK.

      Now, you'll have omvextrasorg 3.4.25 available in the plugins window. Install it.

      After that,, your plugins window will be populated with a lot more plugins that, previously, were not available. At that point, you'll have access to the "Remote Mount" plug-in. (Then, the above screen captures will make more sense.)

      I know this seems abstract but it's the way Management wants it, presumably, for configuration management purposes.

      (I'll be away for a few days but I'll continue to help you, if you have problems, when I get back.)

      Regards
      Good backup takes the "drama" out of computing
      ____________________________________
      OMV 3.0.90 Erasmus
      ThinkServer TS140, 12GB ECC / 32GB USB3.0
      4TB SG+4TB TS ZFS mirror/ 3TB TS

      OMV 3.0.81 Erasmus - Rsync'ed Backup Server
      R-PI 2 $29 / 16GB SD Card $8 / Real Time Clock $1.86
      4TB WD My Passport $119
    • ok I have found and download / installed the remote mount plugin.

      but I have ran into a small issue, and it might be down to me no understanding your notes.

      I have gone through and create a few mounted shares


      forum.openmediavault.org/index…nt/6293-remote-share-JPG/

      NOTE SURE


      Second is setting local shares. You need two. The first one is truly local. The other is a reference to the remote directory, above.
      **In the following, when you set up the remote share, OMV may try to set permissions on the remote. But, if you set up a read only user on your remote NAS (highly recommended) the permissions change won't be allowed. This may create an error. Ignore it.**


      which will then go onto my next issue is mounting my remote shares as I am no able to choose the mount option, as it is greyed out.


      forum.openmediavault.org/index…chment/6294-mounting-JPG/

      haven't tried the rsync at the moment but this is next on my listed once I am able to see my remote mount shares
      Images
      • remote-share.JPG

        24.46 kB, 916×154, viewed 63 times
      • mounting.JPG

        53.33 kB, 1,048×264, viewed 65 times

      The post was edited 3 times, last by chrischambers ().

    • ok I just discovered that my Remote Share connected, after leaving it 24 hours.

      I am that when I create the shares I am getting this error, this this the error you mention flmaxey

      Error #0: exception 'OMV\Exception' with message 'Failed to set file group to 'users' for '/srv/be91d733-dcef-4063-ae9c-04ad285ade1e/Movies': ' in /usr/share/openmediavault/engined/rpc/sharemgmt.inc:339 Stack trace: #0 [internal function]: OMVRpcServiceShareMgmt->set(Array, Array) #1 /usr/share/php/openmediavault/rpc/serviceabstract.inc(124): call_user_func_array(Array, Array) #2 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod('set', Array, Array) #3 /usr/sbin/omv-engined(536): OMV\Rpc\Rpc::call('ShareMgmt', 'set', Array, Array, 1) #4 {main}
    • chrischambers wrote:

      ok I just discovered that my Remote Share connected, after leaving it 24 hours.

      I am that when I create the shares I am getting this error, this this the error you mention flmaxey

      Error #0: exception 'OMV\Exception' with message 'Failed to set file group to 'users' for '/srv/be91d733-dcef-4063-ae9c-04ad285ade1e/Movies': ' in /usr/share/openmediavault/engined/rpc/sharemgmt.inc:339 Stack trace: #0 [internal function]: OMVRpcServiceShareMgmt->set(Array, Array) #1 /usr/share/php/openmediavault/rpc/serviceabstract.inc(124): call_user_func_array(Array, Array) #2 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod('set', Array, Array) #3 /usr/sbin/omv-engined(536): OMV\Rpc\Rpc::call('ShareMgmt', 'set', Array, Array, 1) #4 {main}

      - On the 24 hour interval, maybe something else might in play. I know with Windows, when permissions are changed, logging out and logging on, can be required. I've seen instances where a permission changed didn't work until after a reboot. It's hard to say. Also note that OMV will complain (errors) if a "remote mount" is not up and running. (This might be something that can be turned off, in the future.)

      - On the "greyed out" mount option:
      I have so many shares running, on a Raspberry PI no less, that now I highlight my new share, hover my arrow over the mount button, and wait until it's available. (Waiting for a refresh cycle to take place.) The way I see it, this is a minor inconvenience associated with running a $29 computer as a file server.

      - On the error, I believe this is the error you want to see on creation of remote mount:
      'Failed to set file group to 'users' for '/srv/be91d733-dcef-4063-ae9c-04ad285ade1e/Movies
      The folder above is on another machine.

      With remote share, OMV see's the remote network share (Movies in the above) as "local" and mounts it as if it's a local hard drive. Since it appears to be local, OMV will then try to assign users and permissions. This is why I suggested a user on the remote box named "backup" with "read only" to the shared directory. OMV will pop out an error on creation of the remote mount, but that's it. To do a pull Rsync job, from a remote source, read only is fine. (And I don't think allowing OMV to assign Unix style permissions, on shares hosted by a Windows box is a good idea.)

      Did you get Rsync up yet?
      Good backup takes the "drama" out of computing
      ____________________________________
      OMV 3.0.90 Erasmus
      ThinkServer TS140, 12GB ECC / 32GB USB3.0
      4TB SG+4TB TS ZFS mirror/ 3TB TS

      OMV 3.0.81 Erasmus - Rsync'ed Backup Server
      R-PI 2 $29 / 16GB SD Card $8 / Real Time Clock $1.86
      4TB WD My Passport $119

      The post was edited 1 time, last by flmaxey ().

    • chrischambers wrote:

      the flmaxey, I have got my Remote Mount and also a rsync running, at last.
      thanks for your help.
      Awesome!

      I don't know what you're using for hardware but I think, after using it for 2+ years, you're going to find OMV to be rock solid. I've tested a few different flavors of NAS / Server / Media Streamer and, in my opinion, there are none better than OMV for home and small business use. Once it's set up, it silently goes about its business, pretty much, hands off.
      _______________________________________________________________

      BTW: Since time and use kills all media eventually, give some serious thought to cloning whatever you're using for boot media. (Hard drive, USB thumb drive, SD card, etc.) If your boot media dies (I've had this happen to me) it's really nice to just plug a known good OMV boot spare. And note, if you're not using it now, flash media (USB thumb drives and SD cards) works fine as a boot drive and they're easy to clone.

      **Backup can be very important if you're running the 3.X versions of OMV. The 3.x version is under development so upgrades can, potentially, cause problems. It you encounter an upgrade problem, it's great to be able to drop back to a version that worked for you, until you can figure it out. Accordingly, remember to backup (clone) your boot media BEFORE doing a version upgrade.**
      Good backup takes the "drama" out of computing
      ____________________________________
      OMV 3.0.90 Erasmus
      ThinkServer TS140, 12GB ECC / 32GB USB3.0
      4TB SG+4TB TS ZFS mirror/ 3TB TS

      OMV 3.0.81 Erasmus - Rsync'ed Backup Server
      R-PI 2 $29 / 16GB SD Card $8 / Real Time Clock $1.86
      4TB WD My Passport $119

      The post was edited 2 times, last by flmaxey ().