If you are confidant that a clicking drive can function without causing errors I will look into replacing them (After cleaning contacts and such) I just assumed if the drive was that bad I would have had errors, or slow access, or something.
Thank you.
Posts by Shadow Wizard
-
-
If I had even the slightest error from the array, I would without thinking twice. I was just wondering if anyone that had some experience with ZFS could speak on this.
-
I have a ZFS Raid Z2 array with 8 SAS drives. For over a year now, it seems like at least 1 if not 2 of the drives are bad. However ZFS reports no errors. The array is not slow, and everything works as it should. The only indication any of the drives are bad is the clicking, and the indicator on the drive caddy itself (Details below)
Because these are SAS drives, no smart data is reported, and I am not familiar with any way to check their health status. The system is set up on a ProLiant ML350p Gen8, and each of the caddies has a central orange light that apparently blinks if the system detects issues with the drives, and 2 of the 8 drives are flashing there.
So, should I be concerned? Is there a way to test these drives in place, or get it to give me some kind if report on them? Can I tell ZFS to do an "Extensive test" to see if it can find anything? And most intriguing, I asked 3 questions (4 if you count this one) will people actually answer all 3 of them, or just select one to answer..
-
What does "move" mean in this context? What exactly are you trying to do?
Physically move physical drives to another physical machine running a fresh install of OMV. Sorry, should have been more clear.
-
If I move all the disks in a snapraid to another computer, does it need to be re-created? Or is there a way to just move it all? And if so how do I go about doing it?
-
If I move the disks involved in a mergerfs, des the mergerfs need to be re-created, or is there a way to move it as well?
-
I am in the process of reconfiguring my homelab, the biggest parts of which is my OMV on one bare metal machine, and Proxmox on another bare metal machine. I am bringing another OMV server from another location home as well on its own bare metal machine (One of the HP servers as a matter of fact) then I am trying to incorporate into 1.
Its looking like, considering hardware alone, one of the best options is to switch to a single machine running Proxmox, and passing through either the controllers for the drives directly to a VM running OMV, or the drives themselves. Why use Proxmox to run VM's instead of getting OMV to do it? Because I know Proxmox, I have backups from Proxmox. I know how to restore the backups easily, and its one less thing I need to take a lot of time learning in this major switch over.
So the first question is, is this a bad idea, and why?
Here is a bit of details (Well, I guess it will be a lot of details) about my setup, any a few bits of why I am thinking about this method.
The stars of the new show would be an HP Proliant ML350P Gen 8. It will have 128+ GB RAM, and Dual Xeon processors; more then enough to run my VM's easy, and a EMC KTN-STL3 HDD array. There are about 15 drives total, a mix of SATA and SAS between the OMV nases containing 2 ZFS pools (one only SATA drives and one only SAS), and a SNAPRAID/MergerFS of a few drives for non-critical data. I am currently running 3 bare metal computers. One running a ryzen 5600 for the Proxmox, one running a Ryzen 3600 for one of the OMV servers (It runs quite a few docker containers), and one of the proliants for the other OMV. You don't want to see how fast my electric meter spins! I seem to be unable to get the HDD array to recognize both Sata and SAS at the same time, or at least the computer attached to it. Perhaps I just need to learn how to do it better.All the controllers are set to IT mode; the OSes see each individual drive as a drive, not as a raid array.
My way of thinking is that switching to one of the proliants will give me lots and lots of ram, a bit more CPU power then the 5600 on its own (Yes, I have 2, and 2 of the HDD Arrays. Spare parts) The bays (12) in the proliant will let me run the 6 SAS drives (Or maybe there are 8?) and some of the SATA (The proliant will let me mix and match, just the Array won't for some reason) I can install Proxmox on either an SD card, or even a SATA drive, install a PCIE-NVME adapter or 3 for the VM's, pass through the controllers to the OMV VM (Or the individual drives.. That would be more ideal for me if doable)
Now the second question. Should I pass through the drives (Or CAN I pass through just the drives) or does it have to be the whole controller? Passing through the drives allows me to use drives directly with proxmox for VM's (I know they are not accessible from the OMV container as well, they would be other drives dedicated to running VM's on proxmox)
Are there any other issues/quirks I should look out for doing this? And does anyone have any other suggestions (I am happy to turn this into an open table discussion) other then to run OMV as the "main" os on one bare metal computer.
I look forward to hearing what you all have to say. -
In there any option for this? Snapraid won't work as it isn't real time. Something where I can put in 2x1tb, 2x2 tb, a 3tb (or any other strange combination of drives) and expect to get 6 TB of space out of it?
-
And now they are all installed, with no rhyme or reason...
-
Well, I am working on taking the plunge. Getting ready to rebuild my systems with the newest OMV from OMV 6.
So, as usual, I do everything on a test system first, just a VM to be sure I have all the steps down, and everything works.
And, as usual, something doesn't.
Code
Display MoreRunning the pre_build script: checking for gawk... no checking for mawk... mawk checking metadata... META file checking build system type... x86_64-pc-linux-gnu checking host system type... x86_64-pc-linux-gnu checking target system type... x86_64-pc-linux-gnu checking whether to enable maintainer-specific portions of Makefiles... no checking whether make supports nested variables... yes checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a race-free mkdir -p... /usr/bin/mkdir -p checking whether make sets $(MAKE)... yes checking how to print strings... printf checking whether make supports the include directive... yes (GNU style) checking for gcc... no checking for cc... no checking for cl.exe... no checking for clang... no configure: error: in `/var/lib/dkms/zfs/2.3.1/build': configure: error: no acceptable C compiler found in $PATH See `config.log' for more details Building module: Cleaning build area... (bad exit status: 2) make -j4 KERNELRELEASE=6.5.13-6-pve... (bad exit status: 2) Error! Bad return status for module build on kernel: 6.5.13-6-pve (x86_64) Consult /var/lib/dkms/zfs/2.3.1/build/make.log for more information. Error! One or more modules failed to install during autoinstall. Refer to previous errors for more information. dkms: autoinstall for kernel: 6.5.13-6-pve failed! run-parts: /etc/kernel/postinst.d/dkms exited with return code 11 Failed to process /etc/kernel/postinst.d at /var/lib/dpkg/info/proxmox-kernel-6.5.13-6-pve-signed.postinst line 20. dpkg: error processing package proxmox-kernel-6.5.13-6-pve-signed (--configure): installed proxmox-kernel-6.5.13-6-pve-signed package post-installation script subprocess returned error exit status 2 dpkg: dependency problems prevent configuration of proxmox-kernel-6.8: proxmox-kernel-6.8 depends on proxmox-kernel-6.8.12-9-pve-signed | proxmox-kernel-6.8.12-9-pve; however: Package proxmox-kernel-6.8.12-9-pve-signed is not configured yet. Package proxmox-kernel-6.8.12-9-pve is not installed. Package proxmox-kernel-6.8.12-9-pve-signed which provides proxmox-kernel-6.8.12-9-pve is not configured yet. dpkg: error processing package proxmox-kernel-6.8 (--configure): dependency problems - leaving unconfigured Setting up proxmox-kernel-6.11.11-2-pve-signed (6.11.11-2) ... Examining /etc/kernel/postinst.d. run-parts: executing /etc/kernel/postinst.d/dkms 6.11.11-2-pve /boot/vmlinuz-6.11.11-2-pve dkms: running auto installation service for kernel 6.11.11-2-pve. Sign command: /lib/modules/6.11.11-2-pve/build/scripts/sign-file Signing key: /var/lib/dkms/mok.key Public certificate (MOK): /var/lib/dkms/mok.pub Running the pre_build script: checking for gawk... no checking for mawk... mawk checking metadata... META file checking build system type... x86_64-pc-linux-gnu checking host system type... x86_64-pc-linux-gnu checking target system type... x86_64-pc-linux-gnu checking whether to enable maintainer-specific portions of Makefiles... no checking whether make supports nested variables... yes checking for a BSD-compatible install... /usr/bin/install -c checking whether build environment is sane... yes checking for a race-free mkdir -p... /usr/bin/mkdir -p checking whether make sets $(MAKE)... yes checking how to print strings... printf checking whether make supports the include directive... yes (GNU style) checking for gcc... no checking for cc... no checking for cl.exe... no checking for clang... no configure: error: in `/var/lib/dkms/zfs/2.3.1/build': configure: error: no acceptable C compiler found in $PATH See `config.log' for more details Building module: Cleaning build area... (bad exit status: 2) make -j4 KERNELRELEASE=6.11.11-2-pve... (bad exit status: 2) Error! Bad return status for module build on kernel: 6.11.11-2-pve (x86_64) Consult /var/lib/dkms/zfs/2.3.1/build/make.log for more information. Error! One or more modules failed to install during autoinstall. Refer to previous errors for more information. dkms: autoinstall for kernel: 6.11.11-2-pve failed! run-parts: /etc/kernel/postinst.d/dkms exited with return code 11 Failed to process /etc/kernel/postinst.d at /var/lib/dpkg/info/proxmox-kernel-6.11.11-2-pve-signed.postinst line 20. dpkg: error processing package proxmox-kernel-6.11.11-2-pve-signed (--configure): installed proxmox-kernel-6.11.11-2-pve-signed package post-installation script subprocess returned error exit status 2 Setting up proxmox-headers-6.5 (6.5.13-6) ... dpkg: dependency problems prevent configuration of proxmox-kernel-6.5: proxmox-kernel-6.5 depends on proxmox-kernel-6.5.13-6-pve-signed | proxmox-kernel-6.5.13-6-pve; however: Package proxmox-kernel-6.5.13-6-pve-signed is not configured yet. Package proxmox-kernel-6.5.13-6-pve is not installed. Package proxmox-kernel-6.5.13-6-pve-signed which provides proxmox-kernel-6.5.13-6-pve is not configured yet. dpkg: error processing package proxmox-kernel-6.5 (--configure): dependency problems - leaving unconfigured dpkg: dependency problems prevent configuration of proxmox-kernel-6.11: proxmox-kernel-6.11 depends on proxmox-kernel-6.11.11-2-pve-signed | proxmox-kernel-6.11.11-2-pve; however: Package proxmox-kernel-6.11.11-2-pve-signed is not configured yet. Package proxmox-kernel-6.11.11-2-pve is not installed. Package proxmox-kernel-6.11.11-2-pve-signed which provides proxmox-kernel-6.11.11-2-pve is not configured yet. dpkg: error processing package proxmox-kernel-6.11 (--configure): dependency problems - leaving unconfigured Errors were encountered while processing: proxmox-kernel-6.8.12-9-pve-signed proxmox-kernel-6.5.13-6-pve-signed proxmox-kernel-6.8 proxmox-kernel-6.11.11-2-pve-signed proxmox-kernel-6.5 proxmox-kernel-6.11 Failed to install Proxmox kernel. Exiting... in /usr/share/openmediavault/engined/rpc/kernel.inc:211 Stack trace: #0 /usr/share/php/openmediavault/rpc/serviceabstract.inc(628): OMVRpcServiceKernel->{closure}() #1 /usr/share/openmediavault/engined/rpc/kernel.inc(199): OMV\Rpc\ServiceAbstract->execBgProc() #2 [internal function]: OMVRpcServiceKernel->doProxmox() #3 /usr/share/php/openmediavault/rpc/serviceabstract.inc(124): call_user_func_array() #4 /usr/share/php/openmediavault/rpc/rpc.inc(86): OMV\Rpc\ServiceAbstract->callMethod() #5 /usr/sbin/omv-engined(544): OMV\Rpc\Rpc::call() #6 {main}PLease advise.
Hmm, had to cut this short, as it won't let me post the whole error.. And since I don't know what you need.. well.. If this isn't what you need, please advise what art of the error you need (Or increase my posting limit) and I shall post it.
Wow, I REALLY need to cut this off.. Wow.
-
The reset permissions plugin is a good start. It shows shared folders in use and the disk/path to the shared folder.
If not enough, then use the cli and install ncdu apt install ncdu to see what's on the disk
Thank you, I will look into those.
-
Is there a way to select a dick, under "Storage-->Disks" or anywhere else, to see what is is used for? (It is shared, what directories are shared, is it part of a zpool, or a mergerfs, or anything)
Basically, I had to put a disk in to recover from a mergerfs fail (used it for a restore, then moved all files off of it), and have been having a hard time getting it gone. I want to be sure 100% that OMV isn't using the disk for anything before I just remove it.
-
it isn't restoring properly. Hard to say why.
Use omv-regen to make a backup now and reinstall/restore to new drive following the omv-regen docs.
Seems as though omv-regen will not work either:
Code
Display MoreHit:9 http://download.proxmox.com/debian/pve bullseye InRelease Get:10 https://openmediavault.github.io/packages shaitan InRelease [12.8 kB] Get:11 https://openmediavault-plugin-developers.github.io/packages/debian shaitan InRelease [3934 B] Hit:12 https://download.docker.com/linux/debian bullseye InRelease Hit:13 http://packages.openmediavault.org/public shaitan InRelease Fetched 16.7 kB in 2s (10.8 kB/s) Reading package lists... E: Could not get lock /var/lib/dpkg/lock-frontend. It is held by process 157129 (apt-get) E: Unable to acquire the dpkg frontend lock (/var/lib/dpkg/lock-frontend), is another process using it? Failed updating system. Exiting... root@omvhp:~#Tried more then once.
Ideas?
-
Display More
if you use omv-regen, you need everything fully up to date on OMV7 on the source (incl any plugins). Both source and dest need to be same omv version.
Also I understand that you want to use the new SSD for both OS and docker etc. This is also a totally fine approach.
If it was me doing this, I would start with a new clean omv install (manual setup) on the new SSD. Get OMV setup with docker and plugins you need. Copy the data you need across from the old SSD (such as docker container config (volumes). Create the shared folders. Then use compose to recreate your containers pointing the volumes to the data on the new SSD.
This way you will have a totally new/clean system and all will be good (hopefully).
That sounds like perhaps the best approach, as I don't know if OMV 6 is totally up to date, and updating it likely won't happen with these errors.
Most of my containers do not have volumes of their own, pretty much 90% of my containers use bound directories instead of volumes, so unless I totally misunderstand how docker works all I should need to do is create the containers again pointing them to the same directories, and they should just keep working. If there are no actual volumes for the docker container, there is nothing to backup/restore, is that in fact correct?
For example, my qbittorrent has the "\config" dir bound to "/SixTBpool/Config1/qbittorrent" whereas SixTBpool is a zfs filesystem on separate mechanical drives I will just re-mount under the remake of OMV. So when I recreate the container, I again bind the config directory to "/SixTBpool/Config1/qbittorrent" (Assuming the mount point is the same) and it just picks up where it left off?
-
it isn't restoring properly. Hard to say why.
Use omv-regen to make a backup now and reinstall/restore to new drive following the omv-regen docs.
I was going to ask about that (finding a way to backup the config and re-installing), as it would also permit me to move to OMV 7. The biggest issue I have is making sure my docker containers are properly backed up/restored. Although most can just be re-created from scratch, Seafile and the containers associated with it would be quite bad if they didn't backup/restore properly.
Display Moreand my 2 cents...
If you are trying to restore an image that 'might' have some file corruption then you could end up with a bad system even if you do manage to restore the dd backup.
omv-regen is a good choice especially if you have a load of config in omv that you will take you a load of time to recreate. I have used omv-regen but I usually start with a clean install and manually set everything up again. I have quite a bit of config in my setup and I can get the everything back up and running in about 1 hour. omv-regen will only recreate core omv stuff and so some manual (cli) config will not get restored.
For the manual approach, take screen shots from OMV GUI for things like shared folders, rsync tasks etc to make it easier to setup.
Also you are using a very large drive for omv install. Is this because you are using the disk for other stuff (docker install / container etc)? If so you might want to consider using separate disks. omv works well when installed on USB thumb drive (with flash memory plugin to minimise wear). Then use your new SSD for everything else for the system setup.
What I do and it makes backup / restore much easier is this:
1. omv os/install disk - On a small ssd or usb flash - use it for nothing else
2. omv-system disk - Decent size (240gb is fine) for all system services and data (VMs, docker, containers, config data for containers etc..)
3. omv-data disk(s) - For file / media storage
Honestly, once you have your setup like this (or similar) you will be a happy camper

I have thought about installing it on a USB, but I have the SSD's laying around, I don't have any open bays for SSD's to run the docker containers on, they get backed up with the daily backup and running the docker containers on a drive other than the system disk, although I am sure would be easy to obtain, is a skill I don't posses.But thank you for the suggestion. It is often good to consider other solutions to your issues; in this case however I have considered it and unless there is something I am missing, isn't the best solution for me personally.
-
Hence why I am trying to restore a DD.
So please may I ask for some help on the error I mentioned above, where after a restore (On the same sized drive) Debian rescue reports it is unable to mount the filesystem, and in a live linux I get "can't read superblock on /dev/sda1"
Ideally I would like to get this resolved before a full drive failure. As of right now I am apply any configuration changes. Applying the changes results in "Please wait, the configuration changes are being applied." I wanted overnight, and when I came back, the "working" page disappeared, changes had not been applied, and I was told I needed to apply changes.
-
I will add something else, that may be helpful, or not. I do get these constant errors, and quite often on reboot I am forst to do a Fsck (Or whatever it is that si close to that) You told me in a post many months ago not to worry about it however.
In addition, pretty much any changes to the system (Apply configuration) take forever. Yesterday I stopped looking after about 60 min,.
-
Are you still trying to restore the larger backup to a smaller drive? You can't do that with a dd image.
No, to try and avoid as many issues as I can, I have restored it to a drive of the same size. Original is a 240 GB Kingston SSD, this is a 240 GB SSD of a different make, but 240 still the same.
-
Well, I found the "Rescue Mode" but it doesn't seem like its going to help me.. Or I don't know how to use this (I am SOOO glad I am doing this this way now rather then an actual emergency. I would be in such a bad place..( Anyway)
The rescue was saying it couldnt' mount the filesystem on the device, so I decided to boot into a live linux again to try and browse the drive I recovered the backup to, and it is telling me there is an error mounting it because it "can't read superblock on /dev/sda1"
Now what?
**EDIT**
So I decided to try to restore again, as I figured there was no reason not to. And I am getting the same error whenever I try and read anything off the drive. So I assume either I am doing the restore wrong, or something else is wrong somewhere.
-
Can you provide just a bit more information on the "Rescue option." Is this an option I am given on install (Like in a windows install, "Repair your computer") Or is this a command I use from the command line. A GUI program I use when booting into a live desktop?
And as far as Linux doesn't do many things like windows, I agree. Under most circumstances Linux does stuff better, I agree. I even tried to switch to Linux for my daily driver, but unfortunately it doesn't play well with many of my devices.