Posts by berritorre

    Hi Everyone,


    I just wanted to give some feedback on my progress and thank everyone who helped to get me this far.


    I managed to copy all relevant data from the raid1 to the internal backup disk (via Rsync) as well as to the external USB disks. It took a while, because it was a lot of data that was not up to date on the internal backup disk, but this is a huge step forward.


    So this part is solved, thanks to your help!


    Regarding the new installation, I will still have to make a decision, wether I just go with the interna 120GB 3.5" disk for the syste, or if I install a notebook hdd via the additional sata port or if I go with the system on an USB stick. But the USB ports on the HP Microserver N36L are only USB2 and I also don't have any USB-sticks bigger than 4GB lying around. We generate enough eletronic trash everyday, so I don't really want to buy something new, if I have solutions lying around here.


    But I am still thinking about all this. I will need to do some more research over the next days and I might open a new topic about the installation on USB sticks with USB2 and what the minimum size is for installation on an USB stick. Unfortunately there is no minimum requirement described on the installation manual.


    Anyway, so far: Thank you very much all for the help! :thumbup:

    No worries, the first folder (pdb_backup --> pdb_intbak_backup) is running. Started with the least important one. ;) seems to be running fine, but there are a lot of videos on there, so might take a while.


    Would like to run at least this one and see if all works and then tomorrow I'll start the other two and let them run over the weekend. But 1TB internally shouldn't take forever. So might only be a couple of hours.


    Thank you so much you all. this made my Friday and I finally might get this NAS fixed, having a new version and being able to use the web interface again, make regular internal backups, etc.


    Knowing now that my USB interfaces are all USB2, I might continue to do the backups to the external USB3 drives through a computer of the network though. Might be quicker than running the disk on USB2 directly from the Microserver.


    Still thinking about the USB approach. I am not sure if it is worth running the system from a usb stick if it is only USB2. Will do some more research about it and see if I can find some more background on this.


    Have a great weekend everyone!


    And by now the first syncronization is done: I guess I will start the next one and leave the computer running over night here.


    Code
    sent 88,704,278,009 bytes  received 41,664 bytes  80,530,476.33 bytes/sec
    total size is 123,451,670,595  speedup is 1.39

    Got an error message that --dry.run doesn't work. Had that copied with the typo from Zoki's first post, saw now that it is supposed to be --dry-run.


    Tried it with all 3 folders and it seemed to work just fine:


    Code
    rsync -av --dry-run /media/bbaa055f-7fd0-49bf-b63a-6d75bc3665f7/pdb_backup/ /media/cba71ddf-13bb-4a45-9af4-77d17f6f36bc/pdb_intbak_backup
    
    rsync -av --dry-run /media/bbaa055f-7fd0-49bf-b63a-6d75bc3665f7/pdb_admin/ /media/cba71ddf-13bb-4a45-9af4-77d17f6f36bc/pdb_intbak_admin
    
    rsync -av --dry-run /media/bbaa055f-7fd0-49bf-b63a-6d75bc3665f7/pdb_research/ /media/cba71ddf-13bb-4a45-9af4-77d17f6f36bc/pdb_intbak_research


    I guess I will get rid of --dry-run now and see what happens.

    Quote

    --dry-run will not destroy anything and -v will print the output to the console. the last / (in the target) is not needed

    Yeah, I guess that --dry-run is save, but at the end i will want to run it without --dry-run I guess. What I wanted to say is: There is not much that can go wrong. The worst case scenario is the whole thing not working, which will be the same result as not trying it.


    I'll give it a go, there are 1TB to transfer.

    :?: :/:?:

    yeah, well, hahahhaha. This is me all the time with this stuff. ;)


    Here what I get when I look into media:

    Code
    root@pdb-matrix:/# cd /media/
    root@pdb-matrix:/media# ls -1
    bbaa055f-7fd0-49bf-b63a-6d75bc3665f7
    cba71ddf-13bb-4a45-9af4-77d17f6f36bc
    cdrom
    usb
    usb0

    So there are only 2 drives, [bbaa...] and [cba7...] plus cdrom, usb and usb0. So as I have the system disk, the raid1 and the internal backup disk my reasoning was that this must be the system disk and the raid1, because I know that both work, and I have access to, while the internal backup disk I had not accessed in a while.


    The info about the 3 disks I accessed via:


    And now I see it and feel even dumber as before... the stupid gibberish codes are right there... I had just ignored it. Now I also know how Zoki knows which is the raid and which is the internal disk. Sorry, I was totally blind. Probably filtered out the gibberish in my brain, who knows.

    ooooooh, I might have been stupid.


    It is probably the system drive that doesn't show up in /media/, right?


    I saw only 2 drives and as the system runs and the raid1 runs my conclusion was that the internal backup disk must be missing. That the system disk might not show in /media/ never occored to me.


    Now one question: How do you know that the raid is /media/bbaa... and the internal backup disk is /media/cba7... ? Can you see that from the weird code? To me it says nothing at all.


    Quote


    Please post text in code box, not screen shots.

    Oh, sorry, will do from here on! Thank you for your help so far.


    So here is what I get when checking what is on the /cba7... drive. Seems to be the internal backup disk. Yeahhh!!!! It is there.


    And here is the raid1:

    Code
    root@pdb-matrix:/# ls -la /media/bbaa055f-7fd0-49bf-b63a-6d75bc3665f7
    total 52
    drwxr-xr-x  6 root root   4096 Jan 15  2018 .
    drwxr-xr-x  6 root root   4096 Jan 19  2018 ..
    -rw-------  1 root root   6144 Feb  8  2018 aquota.group
    -rw-------  1 root root   7168 Feb  8  2018 aquota.user
    drwx------  2 root root  16384 Jul 12  2015 lost+found
    drwxrwxr-x 26 root users  4096 May 13 10:26 pdb_admin
    drwxrwxr-x 10 root users  4096 Jul 12  2015 pdb_backup
    drwxrwsr-x  6 root users  4096 May 13 10:40 pdb_research

    This is great. Now I need to rsync the folder pdb_admin on bbaa... to pdb_intbak_admin on cba7...


    Will give this a try. Can't do much more than destroying it anyway, hahahaha. If I can't do it, then I will have to go via the external USB-Backup drive anyway.


    Thank you so much for the help so far. Your advice gave me some hope that I can actually manage to do this!


    Will have some look at this, but I will try something like this:

    Code
    rsync -av --dry.run /media/bbaa055f-7fd0-49bf-b63a-6d75bc3665f7/pdb_admin/ /media/cba71ddf-13bb-4a45-9af4-77d17f6f36bc/pdb_intbak_admin/

    Yeah, that was what I was thinking. I am just not very good at Linux, hahahaha. I'll have a look at your links (thanks Macom and Zoki).


    Now, any idea how to address the raid and how to address the internal backup disk? As in media only one of the two seems to shows up.


    There should be 3 different media show up: the system disk, the raid1 and the internal backup disk. But I only have two:



    The internal backup disk might not be mounted. Maybe I mounted it manually through the web interface. It has been so long now. I will need to do some research on how to mount it via console.


    But then, with df -h it shows everything. Not firm enough in Linux to know if it is mounted then or not. Also, how will I know which of these strange codes belong to which "drive"?


    On the aspect of installing on USB: I just watched this video, not sure if it is very good as he recommends to install the ISO on the USB-drive by burning a CD/DVD first (I don't even have a CD/DVD drive anymore, hahahahaha).


    But he basically says that USB2 is too slow and from what I can see, my HP Microsever N36L only has USB2 ports, not sure if it is worth installing via USB if it is only USB2? Might be too slow for running the system from it?

    Quote

    Not sure when the mount point changed. If you recently mounted it, have a look in /srv instead of /media

    I haven't used the internal backup disk for probably well over a year, as I couldn't access it. There is a good to fair chance that it isn't even mounted.


    Here you can see that there are only 2 disks mounted in /media/:



    The first one with 134 G is the system disk.

    The 1.4TB one is my internal backup disk

    The 2.3T is the Raid1 with the main data. There is a difference of 900-1000GB between the two disks, because I can't do internal backups as the web interface doesn't work for quite some time now. In theory both should have the same data, more or less.


    Before I 'kill' the system and set it up new, I wanted to syncronize the data between the raid1 and the internal backup disk. I have also backed it up on external USB disks, but I would feel more comfortable if I had the interal backup disk up to date as well. And copying from the internal disk should be so much quicker than from an external USB-disk via the network.

    Hi Agricola, thank you for the reply. I will look into this USB approach.


    I think I have a couple of sticks lying around. Some of them are company merchandise, but with 4GB I don't think it is worth giving them out to anyone. Might be too small for this though, as you mentioned 32G and 16G.


    Will need to do some research. I am still trying to get the data from the raid1 copied to the internal backup disk, as this would be so much quicker later to set everything up, by not using an external disk, but rather an internal disk to copy data.


    However, it seems that only the raid or only the backup disk show up in media (see screenshots above).


    Maybe the internal backup disk isn't mounted? Or is the Raid 1 generally not shown in media?

    Thanks! Might look into this and see what type of stick is required and if it is easy to do and setup.


    I had the system running without much "care", especially as I couldn't access the backend anyway. I should have done this quite some time ago, but now I am motivated to really get this running again.


    I like the idea of the USB-Stick and you probably need very little space for the system anyway.


    I have a couple of USB-sticks lying around as well, but I am not sure if they meet the requirements.


    Will do some research in the forum and see how this all works. Because it sounds easy to switch a USB-Stick, just open the front door and the USB port is there.

    Yeah, that is a fairly new one. Mine is this one:



    I think I have seen people running an additional HDD in a casae in the DVD-Slot. Need to do some research if there is an additional sata connector available.


    I am not sure about running the server via the internal usb slot. I have read that the USB sticks die quickly. Might have changed with newer versions of OMV though, haven't looked into this for a long time.

    Zoki: Thank you for your reply.


    Not sure what generaltion 8) is. *lol*


    Mine is first or second generation I think. The old one.


    Afaik mine does not have "hot swap bays". You can easily switch disks out, but they are not hot swappable.


    As I don't really need a fourth data disk in the server, I might not go down that route at the end. I think this would require a little bit more time and when I kill the thing, it should be running again in a couple of days. Ideally I can do this over a rainy weekend.


    But then, it would be nice to have a 4th data disk, or at least the option to put one in, in case we need it.

    @KM0201

    Thank you for your feedback. So for Raid 1 you'd go the same direction that I thought. I think it makes things simpler and also easier to trouble shoot if something goes wrong. And as described, syncs a couple of times per day should be more than enough. Once we go for collaboration via cloud then it could be even less frequent I guess.


    I was thinking about reusing the HDs because I rescued them from notebooks that had other issues and were discarded. It is not necessarily about costs, but these hard drives should just work fine and I don't like to throw them away.

    Ok, I was doing some research on how to access my shares via CLI and if I can somehow find out how to sync the files from the raid to the internal backup disk.

    Found this post here (old but seems to be valid): Noob Q: access my shared files via shell/ssh?


    So I went

    Code
    cd /media/
    ls

    and got two shares plus cdrom (doesn't exist in my server) and usb and usb0.


    bbaa055f-7fd0-49bf-b63a-6d75bc3665f7 cba71ddf-13bb-4a45-9af4-77d17f6f36bc cdrom usb usb0


    Now I went into the shares and bbaa055f-7fd0-49bf-b63a-6d75bc3665f7 seems to be the share with the data and cba71ddf-13bb-4a45-9af4-77d17f6f36bc seems to be the system disk? Because it only includes this:


    php5-pam_1.0.3-2_armhf.deb php5-pam_1.0.3-2_armhf.deb.1


    But I should actually have the raid1 and the internal backup disk. Or does the raid1 not show up in /media/?


    OK, with df -h I actually found that I have this:



    /dev/sda1 is the disk with the system.

    /dev/sdd1 is most probably the internal backup disk. You can see that I am about 900 GB behind in internal backups compared to the raid1

    /dev/md0 must be the raid system.


    So the question is how do I get my files stored in the folders pdb_admin and pdb_research from md0 to sdd1? Will need to do some research.

    I am running a OMV 4 installation on a HP Microserver for years and it works pretty well for my needs (few users).


    Here the situation:

    • HP Mircoserver with 4 Disk Slots
      • 1x 250 GB for system
      • 2x 3TB in Raid1
      • 1x 3TB for internal backup (e.g. 2 times a week)
      • 2x external USB3 disks for offsite backup (each Friday with 1 disk, so each disk gets a backup every 2 weeks)

    My problem: Some time ago an update killed my GUI and even with the help of the forum I didn't manage to get it to work again. And from there on things went downwards.... :D


    I can still access the shared folders and everything, so the NAS is in use as a file server, but since then I had do do backups via "FreeFileSync" through my computer to the external hard disks (which is slower) and as I am not very good at Linux the backup from Raid1 to the internal backup disk never happened again. Yes, I know, I could probably trigger the backup via command line somehow, but - you know... :rolleyes:


    OK, so currently I am making my backups from everything to different external disks to make sure I have everything, before I "kill" the current installation.


    However, ideally I would also be able to copy everything from the raid the the internal backup disk, but I am not sure how I can do this safely. I assume I will have to figure out to rsync this somehow.


    To make things worse: I could in theory access the shares on this backup disk, but somehow I can't find the correct password and Windows won't let me access these shares without the password. Tried all my passwords that I usually use, to no avail. Is there any way to find this password via command line? Or change it (but wouldn't want to risk this, if necessary, because currently I can access the other shares on the raid and currently still need to work with this). But once I "kill" the installation, I could also try changing the password and try to make a copy, if anything else doesn't work. But I think it is probably easier to syncronize the raid to the internal backup disk directly. This should also help me to quickly setup the system again. Any tips how I can get the raid to the internal backup disk easily? (I am not very firm in linux commands, but I can follow instructions... 8) ).


    Now to the new system:


    I would like to get some tips from the experts on this, so that I setup my new system well. Here a few thoughts that I have:

    • I have a couple of notebook HDs lying around and could think of using one of these for the system (not sure how I will put it in the server yet, but I have read that some people such a 5th disk in the HP Microserver for the system and the 4 normal slots for data). Not that I will need much more space in the near feature. I am getting towards the end of my 3TB disks (am at around 2.5 TB), but I have projects on there that are over 10 years old and I can start to delete those now I think. So I am planning with the old 3TB disks for now, but might buy bigger for any that needs replacement.
    • Raid1: at the time i thought it would be a good idea to have the availability of the two disks in Raid1 and then have the internal backup disk for local backup (plus the external usb drives for offsite backup). But to be honest, I am not very sure if the Raid1 is such a good idea. First of all, I was not able to access the data on the disks when they are not in Raid. I guess this is normal, but it makes me a little unconfortable. What if the server fails and I can't setup a new raid. Or what if I can't get a new disk quickly? I think I'd rather have the two disks separate and a syncronization via rsync or something every hour. Because current project are also always on the local computer, so even if the main disk fails and the data hasn't been synced to the second disk yet, it is no big deal, the data should still be on the local computer until the end of the project. And by the end of the project the files should also already be on various other disks (internal backup disk and external backup disks).
      • So what are your recommendations for the OMV6 setup: Raid1 or not? I am currently leaning towards no raid because I feel more comfortable getting data back from the disk without raid.
      • So was thinking the following setup:
        • Disk 1: System (might swap that to a notebook HD that I put into the HP Microserver, but not sure if I want to go down this route)
        • Disk 2: Main data disk where users save and access projects
        • Disk 3: "Mirrored" data disk (I don't know what a good frequency would be, but as we might need to go down the Windows 365 route soon, the main collaboration will be via cloud anyway, and the NAS will be actually just a local backup of what happens in the cloud. So I am currently thinking about something like hourly or daily might actually be enough for this "mirrored" disk.
        • Disk 4: This would be like my current internal backup disk and depending on the sync frequency of Disk 2 to Disk 3 I could imagine daily or twice weekly.
        • (Disk 5: should I go down the route and install OMV on an additional disk, I would have one of the main slots free and could add another 3.5 disk to the server)

    So overall, I would like to hear your opinion and how you would set this up and why. I understand that use cases can be vastly different and your approach might not be the right one for me, but I would like to hear some opinions and understand the reasoning behind it, so I can see if I could have a better setup. Mine worked well to the point when the GUI went away and I wasn't able to get it back. But even then, the system did still what it was supposed to be, but I couldn't make any changes anymore, etc. which was a pain and I want to be able to administer the server again.

    OK, so almost 3,5 years later and I am still stuck here. As the file server worked, I just left it be, but without the Web GUI I can't change anything, I can't really add new users, nothing. So before I totally kill this installation and set up a new one (either with OMV or any other software to provide a file server), I will try another time to get this error fixed (and hopefully update to a newer version of OMV, which is of course preferred over doing a new install and having to transfer almost 3GB of data back and forth.


    So I managed to check via command line that I am currently on 4.1.13-1.


    My suspicion was that some plugin caused problems during the update, but I don't know.


    But then above I see errors regarding php7.0-fpm, and "ERROR: [pool openmediavault-webgui] cannot get u…webgui'", so I guess the problem might be with php7.0-fpm?


    Any help would be appreciated!

    Hi!


    I have made an upgrade from 2.x to 3.x and then directly 4.x. Unfortunately I get the following error message:


    502 Bad Gateway nginx


    I have asked for help a while ago in another thread: No Webinterface after Upgrade to 3.X - 502 Bad Gateway (I cleared my browser cache)


    Unfortunately I couldn't solve the problem until now. So I don't have access to the web interface since end of february. So far I have helped myself by shutting down the server via command line and I did the weekly backups to the external usb backup drive manually. But I would love to be able to use the webinterface again. Just much more convenient... ;)


    I ran an update / upgrade process today again. And during this process a few error messages appear when running update and upgrade.


    omv.txt


    Any idea on how to fix this? If I am not able to fix this, my only chance is probably setting up a new instance of OMV, but this would also mean that I would have to set up all users, all shares, etc. and I remember from last time, that this was quite a hassle.

    Just in case you are interested: Went to a technician to check the server and at the end the problem was dirt, it seems. At least they charged me for cleaning the server and it is running since without any noise.


    Now I only have the problem that I can't access the stupid WebGUI after an upgrade... but that is a different story.

    Hi! Was out of the office for some time, but I am now back to try to get this solved.


    So somehow I am running into trouble with the webinterface. I can synchronize data to the shares on my server, I can access them, but I can't get into the webinterface, as it gives me a 502 error by nginx.


    I tried to run your recommendations again and here are the errors I get:


    Here the error for apt-get purge apache2*






    When I run apt-get upgrade it looks pretty much the same. But will give that in the next message because the response is too long.



    So if I read those error messages correctly, openmediavault and php7.0-fpm haven't been installed correctly?