Rsync from Qnaps Server to a Raspberry OMV

  • I know that this is not a QNAPS fourm, but I think the problem I am having resides on the OMV, and I hope that someone can assist me in finding and resolving this issue.


    Source NAS
    Qnas TS-469 Pro


    destination
    OMV Version 2.2.5


    Ok I am trying to set up a Rsync / backup from my Qnaps NAS to a Destination Server ( OMV )


    I have created the shares on my OMV with no issues, and I have tested that I have access to the folders from a windows platform,
    by dragging and dropping a few files over to the omv share.



    Now that I am happy that all is working, I would like to set up a schedule backup of all my data from my Qnas to my OMV.
    but when I started to create the jobs on the QNAPS server , I ran into a little problem.


    I have enter in the settings for the OMV server and check the connection, and it is reporting back successful,
    I then choose the Source folder which I want to be backup, but when I choose the destination folder, the options for this is is blank.


    http://pixady.com/image/pfp/


    is there something I am missing on the OMV server that will allow the QNAPS to search / index the folder structure ?

    • Offizieller Beitrag

    It's probably a permissions issue. If you set permissions to allow Guests to "write", on the OMV side, Qnas should be able to "push" to the OMV share. (But that's risky if your LAN has open ports to the world. Further, I doubt you'll be able to find much help with Qnas on this forum.)
    _____________________________________________


    Why not pull the directory from Qnas to OMV, using Rsync on the OMV server?


    I setup a user named "backup", on a windows server, that has read only access to shared directories I wanted to back up to OMV. From there I used the remote mount plugin (in your case, using OMV 2.2.5, it would be the "remote share" plugin), specified the user name "backup" and password, to mount the remote share. (To OMV, the remote share now looks like it's local.)


    I created a local shared folder on OMV, as a destination directory, and set up a local Rsync job. The source for the Rsync job is the remote share (in your case on Qnas) the destination is the local shared folder on OMV.


    I'm backing up 10 network shares, in this manner. All is working well.

  • Hi Flmaxey


    thanks for you help and procedure on how to get this to work. but I have ran into a little issue.
    when I go and install the plugin " Openmediavault-remoteshare 1.1" I am informed the following



    Building dependency tree...
    Reading state information...
    The following packages were automatically installed and are no longer required:
    libck-connector0 libexif12 libgphoto2-2 libgphoto2-l10n libgphoto2-port0
    libgusb2 libieee1284-3 libpam-ck-connector libpolkit-agent-1-0
    libpolkit-backend-1-0 libsane libsane-common libsane-extras
    libsane-extras-common sane-utils
    Use 'apt-get autoremove' to remove them.
    The following extra packages will be installed:
    cifs-utils curlftpfs davfs2 fuse-utils glusterfs-client glusterfs-common
    libibverbs1 libneon27-gnutls sshfs
    Suggested packages:
    smbclient glusterfs-examples
    Recommended packages:
    keyutils winbind
    The following NEW packages will be installed:
    cifs-utils curlftpfs davfs2 fuse-utils glusterfs-client glusterfs-common
    libibverbs1 libneon27-gnutls openmediavault-remoteshare sshfs
    0 upgraded, 10 newly installed, 0 to remove and 82 not upgraded.
    Need to get 10.3 MB of archives.
    After this operation, 26.0 MB of additional disk space will be used.
    WARNING: The following packages cannot be authenticated!
    cifs-utils curlftpfs fuse-utils libibverbs1 glusterfs-common
    glusterfs-client libneon27-gnutls davfs2 sshfs openmediavault-remoteshare
    Authentication warning overridden.
    Err http://packages.omv-extras.org/debian/ stoneburner/main openmediavault-remoteshare all 1.1
    Something wicked happened resolving 'packages.omv-extras.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main cifs-utils armhf 2:5.5-1
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main curlftpfs armhf 0.9.2-5
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main fuse-utils all 2.9.0-2+deb7u2
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main libibverbs1 armhf 1.1.6-1
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main glusterfs-common armhf 3.2.7-3+deb7u1
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main glusterfs-client armhf 3.2.7-3+deb7u1
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main libneon27-gnutls armhf 0.29.6-3
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main davfs2 armhf 1.4.6-1.1+wheezy1
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Err http://mirrordirector.raspbian.org/raspbian/ wheezy/main sshfs armhf 2.4-1
    Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…ifs-utils_5.5-1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…rlftpfs_0.9.2-5_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…ls_2.9.0-2+deb7u2_all.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…bverbs1_1.1.6-1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…_3.2.7-3+deb7u1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…_3.2.7-3+deb7u1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…gnutls_0.29.6-3_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…4.6-1.1+wheezy1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://mirrordirector.raspbian…use/sshfs_2.4-1_armhf.deb Something wicked happened resolving 'mirrordirector.raspbian.org:http' (-5 - No address associated with hostname)
    Failed to fetch http://packages.omv-extras.org…t-remoteshare_1.1_all.deb Something wicked happened resolving 'packages.omv-extras.org:http' (-5 - No address associated with hostname)
    Unable to correct missing packages.
    E: Aborting install.
    <<< *************************************


    is this due to the fact the version I am using is no longer supported ?

    • Offizieller Beitrag

    is this due to the fact the version I am using is no longer supported ?

    Nope, you need to set your dns server in network settings.

    omv 7.0.4-2 sandworm | 64 bit | 6.5 proxmox kernel

    plugins :: omvextrasorg 7.0 | kvm 7.0.10 | compose 7.1.2 | k8s 7.0-6 | cputemp 7.0 | mergerfs 7.0.3


    omv-extras.org plugins source code and issue tracker - github


    Please try ctrl-shift-R and read this before posting a question.

    Please put your OMV system details in your signature.
    Please don't PM for support... Too many PMs!

  • I can't believe I forgot the DNS. My Bat


    ok, I have a new question,


    after I have resolved my "School Boy Error" and installed the Plugin,
    I then created a new share on my OMV called "NAS" with Administrators to have full access and users with read only
    next I click on the Remote Shares and started to create a new mounted share to my NAS


    here is the information I have enter


    server 192.168.0.7 (This is the IP Address is the NAS)
    Export ??
    Shared Folder thenas (This is the new share I am trying to mount the NAS to)
    NFSv4 - Disable
    Extra Options intr


    can you please inform me on what I need to enter into the Export box, and also if I am filling in the information right.

    • Offizieller Beitrag

    The following is (roughly) the drill. **Note I'm using "remote mount" (OMV 3.0.68) where you're using "remote share" (OMV 2.2.5), so your plugin will look different. The remote shares I'm mounting are Samba / Windows shares.


    This is the first step. This allows OMV to treat the remote share as a local directory.



    Second is setting local shares. You need two. The first one is truly local. The other is a reference to the remote directory, above.
    **In the following, when you set up the remote share, OMV may try to set permissions on the remote. But, if you set up a read only user on your remote NAS (highly recommended) the permissions change won't be allowed. This may create an error. Ignore it.**



    The following is the detail of setting up the remote directory as a local share. Name it anything you like. (I identified my remote directories with _R to keep them straight) The second drop down is the remote share itself. Note "/" means the "root" of the remote share. (By default, the dialog window may enter something like "/Backups_R") If anything is added here that is not a sub-directory in the remote, it won't work. If you want to Sync everything on the remote share, "/" should be entered here.



    Finally, set up you Rsync Job. (Don't turn on "Quiet", "suppress non error warning messages". If you do, you won't see file progress when manually triggering a job. At first, that had me believing something was wrong.)
    Note that the source is the remote and the destination is local.



    More detail. Make sure to use / turn on "Keep partially transferred files". This can be important in large sync jobs.



    Let me know how it goes.

  • ok, I am still having issues, and I have decided to bin the old version and install the version 3.0.72
    I have ran and install all the updates that it listed,


    I then tried to locate and install the remote mount, so that I am follow your steps, but I am not able to locate it in the plugs.
    I have gone in and check the community maintained updates, but still no option to install.


    can you please advice on where to find this plugin.

    • Offizieller Beitrag

    (I use a Raspberry PI so the OMVExtras plugin is available by default. When I started a standard build, I was surprised to the learn the following.)
    _____________________________________________


    SInce you're using the installer versions of OMV, you'll have to down load the file found here. ->


    **For OMV 3.x (erasmus)
    - omv-extras.org/openmediavault-omvextrasorg_latest_all3.deb


    (Put it on your desktop.)
    From the web GUI, in the <SYSTEM>, <PLUGINS> window, click on "Upload". Browse to the file downloaded file and click on OK.


    Now, you'll have omvextrasorg 3.4.25 available in the plugins window. Install it.


    After that,, your plugins window will be populated with a lot more plugins that, previously, were not available. At that point, you'll have access to the "Remote Mount" plug-in. (Then, the above screen captures will make more sense.)


    I know this seems abstract but it's the way Management wants it, presumably, for configuration management purposes.


    (I'll be away for a few days but I'll continue to help you, if you have problems, when I get back.)


    Regards

  • ok I have found and download / installed the remote mount plugin.


    but I have ran into a small issue, and it might be down to me no understanding your notes.


    I have gone through and create a few mounted shares



    http://forum.openmediavault.or…nt/6293-remote-share-JPG/


    NOTE SURE



    Second is setting local shares. You need two. The first one is truly local. The other is a reference to the remote directory, above.
    **In the following, when you set up the remote share, OMV may try to set permissions on the remote. But, if you set up a read only user on your remote NAS (highly recommended) the permissions change won't be allowed. This may create an error. Ignore it.**



    which will then go onto my next issue is mounting my remote shares as I am no able to choose the mount option, as it is greyed out.


    http://forum.openmediavault.or…chment/6294-mounting-JPG/


    haven't tried the rsync at the moment but this is next on my listed once I am able to see my remote mount shares

  • ok I just discovered that my Remote Share connected, after leaving it 24 hours.


    I am that when I create the shares I am getting this error, this this the error you mention flmaxey


    Error #0: exception 'OMV\Exception' with message 'Failed to set file group to 'users' for '/srv/be91d733-dcef-4063-ae9c-04ad285ade1e/Movies': ' in /usr/share/openmediavault/engined/rpc/sharemgmt.inc:339 Stack trace: #0 [internal function]: OMVRpcServiceShareMgmt->set(Array, Array) #1 /usr/share/php/openmediavault/rpc/serviceabstract.inc(124): call_user_func_array(Array, Array) #2 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod('set', Array, Array) #3 /usr/sbin/omv-engined(536): OMV\Rpc\Rpc::call('ShareMgmt', 'set', Array, Array, 1) #4 {main}

    • Offizieller Beitrag

    ok I just discovered that my Remote Share connected, after leaving it 24 hours.


    I am that when I create the shares I am getting this error, this this the error you mention flmaxey


    Error #0: exception 'OMV\Exception' with message 'Failed to set file group to 'users' for '/srv/be91d733-dcef-4063-ae9c-04ad285ade1e/Movies': ' in /usr/share/openmediavault/engined/rpc/sharemgmt.inc:339 Stack trace: #0 [internal function]: OMVRpcServiceShareMgmt->set(Array, Array) #1 /usr/share/php/openmediavault/rpc/serviceabstract.inc(124): call_user_func_array(Array, Array) #2 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod('set', Array, Array) #3 /usr/sbin/omv-engined(536): OMV\Rpc\Rpc::call('ShareMgmt', 'set', Array, Array, 1) #4 {main}


    - On the 24 hour interval, maybe something else might in play. I know with Windows, when permissions are changed, logging out and logging on, can be required. I've seen instances where a permission changed didn't work until after a reboot. It's hard to say. Also note that OMV will complain (errors) if a "remote mount" is not up and running. (This might be something that can be turned off, in the future.)


    - On the "greyed out" mount option:
    I have so many shares running, on a Raspberry PI no less, that now I highlight my new share, hover my arrow over the mount button, and wait until it's available. (Waiting for a refresh cycle to take place.) The way I see it, this is a minor inconvenience associated with running a $29 computer as a file server.


    - On the error, I believe this is the error you want to see on creation of remote mount:
    'Failed to set file group to 'users' for '/srv/be91d733-dcef-4063-ae9c-04ad285ade1e/Movies
    The folder above is on another machine.


    With remote share, OMV see's the remote network share (Movies in the above) as "local" and mounts it as if it's a local hard drive. Since it appears to be local, OMV will then try to assign users and permissions. This is why I suggested a user on the remote box named "backup" with "read only" to the shared directory. OMV will pop out an error on creation of the remote mount, but that's it. To do a pull Rsync job, from a remote source, read only is fine. (And I don't think allowing OMV to assign Unix style permissions, on shares hosted by a Windows box is a good idea.)


    Did you get Rsync up yet?

    • Offizieller Beitrag

    the flmaxey, I have got my Remote Mount and also a rsync running, at last.
    thanks for your help.

    Awesome!


    I don't know what you're using for hardware but I think, after using it for 2+ years, you're going to find OMV to be rock solid. I've tested a few different flavors of NAS / Server / Media Streamer and, in my opinion, there are none better than OMV for home and small business use. Once it's set up, it silently goes about its business, pretty much, hands off.
    _______________________________________________________________


    BTW: Since time and use kills all media eventually, give some serious thought to cloning whatever you're using for boot media. (Hard drive, USB thumb drive, SD card, etc.) If your boot media dies (I've had this happen to me) it's really nice to just plug a known good OMV boot spare. And note, if you're not using it now, flash media (USB thumb drives and SD cards) works fine as a boot drive and they're easy to clone.


    **Backup can be very important if you're running the 3.X versions of OMV. The 3.x version is under development so upgrades can, potentially, cause problems. It you encounter an upgrade problem, it's great to be able to drop back to a version that worked for you, until you can figure it out. Accordingly, remember to backup (clone) your boot media BEFORE doing a version upgrade.**

Jetzt mitmachen!

Sie haben noch kein Benutzerkonto auf unserer Seite? Registrieren Sie sich kostenlos und nehmen Sie an unserer Community teil!