Posts by godfuture

Quote from ryecoaaron

Only if someone else writes the code. There is nothing stopping you from adding encryption from the command line.

Since you are doing it from the command line, you can probably use whatever you want.

That is just begging to have problems especially timing on startup. I would not do that.

Can something like this be used with zfs? Because till now I see only possibility with files...

dev-crypt /dev/disk/by-uuid/dev-crypt-uuid /dev/disk/by-id/usb-myStick luks,tries=3,keyfile-size=4096,keyfile-offset=512

If this would work, how to plan auto mount with zfs? Is systemd service file the only way as the thread owner published?

I am also interested into zfs native encryption. Till now I am working with mdadm, luks, lvm and ext4/btrfs. I want to reduce complexity, but there are no GUI options for encryption in openmediavault-zfs plugin. Also my luks automount is organized with non-file based key read from usb stick.

Till now I have seen only passkey or binary file encryption with zfs. I would have to implement a script that reads from usb stick to write temporally to tmp device just to let zfs read from it. As I had issues with systemd service files to get them working properly timed during boot, I am scared to go down this path.

Is it planned to get zfs native encryption into the plugin? And will the use of USB sticks (non file based keys) be part of the solution like it is for luks?

Otherwise I think I have to use luks beneath zfs and encrypt every drive separatly.

Quote from chente

What is the output in your system of:

root@server:~# dpkg -l | grep openmediavault

ii  openmediavault                        7.4.8-1                              all          openmediavault - The open network attached storage solution
ii  openmediavault-backup                 7.1.4                                all          backup plugin for OpenMediaVault.
ii  openmediavault-compose                7.2.4                                all          OpenMediaVault compose plugin
ii  openmediavault-cputemp                7.0.2                                all          cpu temperature plugin for openmediavault
ii  openmediavault-diskstats              7.0.1-2                              all          openmediavault disk monitoring plugin
ic  openmediavault-flashmemory            4.1                                  all          folder2ram plugin for OpenMediaVault
ii  openmediavault-kernel                 7.1.3                                all          kernel package
ii  openmediavault-keyring                1.0.2-2                              all          GnuPG archive keys of the openmediavault archive
ii  openmediavault-luksencryption         7.0.2                                all          OpenMediaVault LUKS encryption plugin
ii  openmediavault-lvm2                   7.0-2                                all          openmediavault Logical Volume Manager (LVM2) plugin
ii  openmediavault-omvextrasorg           7.0                                  all          OMV-Extras.org Package Repositories for OpenMediaVault
ii  openmediavault-rsnapshot              7.0.1                                all          OpenMediaVault rsnapshot backup plugin.
ii  openmediavault-sharerootfs            7.0-1                                all          openmediavault share root filesystem plugin
ii  openmediavault-symlinks               7.0                                  all          OpenMediaVault symlinks pluginii  openmediavault-usbbackup              7.1.0-1                              all          openmediavault USB/eSATA/SAS/SD backup plugin
ii  openmediavault-wol                    7.0.1                                all          OpenMediaVault WOL plugin
ii  openmediavault-zfs                    7.1.1                                amd64        OpenMediaVault plugin for ZFS

I ran into it as well, and I suspect the upgrade fail because of it.

Do you know why this issue occured? If not, did you have issues after this error happened? I mean can it be fixed properly?

Quote from chente

The omv-release-upgrade command will only be available when you upgrade the system with the correct command:

omv-upgrade

Edit: I just saw that I made a typographical error in my previous post, it has now been corrected.

Could you explain a little? What means will only be available when you upgrade the system with the correct command? I ran into this as well. I executed omv-upgrade. Then omv-release-upgrade. Then I got an error (just like reported here omv 6 to 7 upgrade grub-pc error

Errors were encountered while processing:
grub-pc
E: Sub-process /usr/bin/dpkg returned an error code (1)

I guess this means the upgrade failed short before end, but nonetheless never really finished properly. At first glance, everything looks fine. But this is just an impression. Now after upgrade, executing omv-release-upgrade gives me: -bash: omv-release-upgrade: Kommando nicht gefunden.

As I had issues, I don't know what to expect. Therefore the question: can I expect the command omv-release-upgrade to be available after upgrade?

Exact same with me. All disks that I had connected to front USB ports, produced ugly IO errors. Connecting to back ports is working without issues.

Does someone know why?

I can confirm. Since I swapped my DeLOCK 89384 with LSI 9500-16i, no ata errors in kernel log anymore.

I can confirm. Since I swapped my DeLOCK 89384 with LSI 9500-16i, all issues with hanging UI are gone.

Many thanks for all the support. Very happy now

I hope this thread can help others also being fooled by cheap sata controller.

Quote from olduser

The 9300-16i runs EXTREMELY hot! It's technically 2 packages (2 8-ports). I'd be weary for smaller builds. For a time I had it replaced with a 9305-16i which ran ~15c cooler.

I could cancel my order. I had luck due to Chinese holidays. The cheapest 9305-16i incl. cables was 190€, but I have found 9500-16i for 243€. Lower power consumption 24/7 will pay off over years. Therefore I think the better option...also having the better product in the end.

Many thanks for all the support. I finally figured out what stressed me since I started to selfhost.

Should there not be a guide in hardware section of this forum that excatly explains these things to beginners?

I think it could save a lot of time and prevent many issues that are being reported here in different threads as symptoms of the core problem.

Quote from olduser

The 9300-16i runs EXTREMELY hot! It's technically 2 packages (2 8-ports). I'd be weary for smaller builds. For a time I had it replaced with a 9305-16i which ran ~15c cooler.

The board I am using only has one 16x PCIe, all other are just 1x. There is a long story behind it, but to make it short, two important points that led me into this: price and transcoding.

I wanted to have an Intel CPU because their GPU has good transcoding. But I could not find a cheap board having multiple x16 or x8 slots.

Thats why I need a card bundling a lot of ports into one entity.

Alright, I will try to cancel my order and watch out for 9305-16i, even it will be much more expensive.

Thanks for all your help. Really looking forward having my server without these ata kernel timeouts anymore.

Quote from Krisbee

godfuture

I didn’t get a chance to add to my previous comment before you decided to purchase a replacement for the DeLock SATA card. So I may be too late with these few thoughts.

It’s not hard to find consumer computer parts on sale which are of dubious design and/or quality whether that’s on Amazon, AliExpress, Ebay or normal retail channels. The DelocK card basically uses a two channel SATA chip (ASM1062 ) with each channel linked to a port multiplier ( JMB575). That’s 2x5, giving 10 ports.

This is like having five HDDs working off a single SATA port, all waiting their turn for IO. Once the HDDs are combined in software RAID they need simultaneous access which the card design doesn’t adequately support. Hence the horrible performance.

When it comes to buying a SATA card to increase the number of ports above those on your m/board, it’s a case of buyer beware. You need to check the chipsets actually used, eg. Marvell, Jmicron, ASMedia, and how they are combined.

There a couple of things to consider for anyone thinking of buying/using a server grade HBA, which are often s/hand.

1. Watch out for fakes.

2. They need adequate cooling as they were designed to be used in high air flow server kit.

3. They introduce a single point of failure.

To mitigate point 3, with one 8 port card & mirror RAID10 connect one side of the mirror to one 4 port channel and the other mirror side to the second channel and so on.

Last but not least, as you have 10 HDDs in some kind of RAID configuration, all ten in a single RAID5 is a bad choice. Loose a single drive and your array becomes fragile, a further problem during a long re-sync, or a second HDD is kicked out and that spells disaster and a lengthy restore. Consider using RAID6 limited to eight drives and hold two spares if high availability is the aim. If you data has different usage patterns, e.g. some volatile but other data mostly static, then segregation may offer better choices for how to combine your drives.

Display More

This is the post I should have received many years ago.

My setup is very special. I have two SSDs for system in RAID1 (OMV is normally installed on one disk). I have 3x disks in RAID5 for Nextcloud and backups (I have written scripts to create a backup before upgrades), 5x disks in RAID5 for my media and 2x disks in RAID0 for everything that needs speed. So no, not all disks are in one array!

The LSI card should be the right one. How to see if it is fake? https://www.ebay.de/itm/195717998105

Many thanks!

Edit: channels, ports, IT mode, full duplex, port multiplier....this storage topic isnt easy at all!

Quote from Krisbee

Maybe starting a new thread asking about the DeLOCK 8938 card would grab people's attention rather than tagging onto an old thread. But the message I take from the old thread is to just to ditch the DeLOCK and get yourself a server grade RAID card capable of running as a pure Host Bus Adapter (HBA) in IT mode. One card will support 8 drives.

I've no idea how your hardware is setup. Whether you're using consumer or server grade parts, nor what kind of case and cooling you're using, nor how your 10 HDDS are combined.

Among other things you can see in top is the kind of iowaits your system has. Things point to the DeLOCK 8938 card as a possible bottle neck and perhaps even a source of file errors.

I was wasting so many days, weeks, maybe even months of searching the internet and trying out stuff. You took the right conclusion in few hours. Yes, you are right. This card messed up everything. I already ordered LSI Broadcom 9300 16i card.

Quote from Krisbee

OK you've got your answer as to why the DeLOCK card is bad for your setup.

JMB575 is a port multiplier chip and not suitable for RAID applications. Just google JMB575 + RAID.

I didnt know port multiplier is a problem with RAID. I have seen a lot of complain about the kernel errors I experienced, because I was googling like hell. It seems you know a lot more than many admins out there.

Just got response from DeLock (very quick response!):

2x JMB575 and 1x ASM1062 chip is being used on DeLOCK 89384 (current model).

Quote from Krisbee

Is your hardware the reason of your problems ? I refer to your own post: RE: Kernel ATA Error Messages while using HDD Cache

Good catch. I think it is possible. Thats why I wanted to ask if others are seeing my problems as well.

Sorry, my signature is not updated. I am on omv6. And yes, cli does work, but web is the idea of OMV.

And generally not the whole OMV UI hangs, but many disk related apps/views do not work anymore. So if I can get information with cli, why would the web UI not get this information and hang?

I am pretty late, but I have 100% same situation.

10 HDDs, Openmediavault, DeLOCK 89384, all SMART ok, "retrying FLUSH 0xea Emask 0x4" under high load.

Edit: I contacted DeLOCK, but they dont see any issues with the card. So it would be interesting to know the exact name of the DeLock JMicron chip being used.

Does someone have any idea? I run again into this and it is really frustrating

I also have a lot USB hdd issues. I bought a Seagate Deskdrive which sometimes worked at the USB 2.0 port. But very likely failed on USB 3.0.

But lately also on USB 2.0 I see issues. Then I shucked the drive and bought a Inoteck USB 3.0 SATA adapter. Same problem here.

My personal issue is a bit that I dont know how to monitor or debug all these situations. I just see EOF errors while copying files via my docker container "cloud commander". And I see io errors in dmesg.

Summary is...all these USB drives perfectly work on my windows machine, but rarely to never work on my Intel board running openmediavault/Debian with kernel 6.1 (...and also 5.19).

Edit: I stopped plugging the external drives into the server to move data. I am using a notebook wired to local network and transfer the data via shared folders. I get better speed, no interruptions and no data corruptions.

Quote from cubemin

Edited /etc/cron.d/mdadm and replaced 57 0 * * 0 with 56 23 * * 2 (Tuesday at 11:56 p.m.).

Then issued

Code

echo 120000 > /proc/sys/dev/raid/speed_limit_max
echo 40000 > /proc/sys/dev/raid/speed_limit_min

to limit resync speeds to between 40MB/s and 120MB/s.

Guess I'll find out how well it works on February 2nd.

Display More

I have changed /etc/cron.d/mdadm to "57 0 * 2,5,8,11 0". Lets see if that works