No updates found due to exception and zfs cannot start

As I wrote in another thread, I suspect I have a memory leak and I suspect it is Embys Library scan.
Therefore I started with an update of the system by selecting all packages on Update Manager page and when that was done I also added OMV 2.2.3 that appeared.

Next I wanted to update Emby to the latset version as well, so I checkked for new updates (as I still had the previous version of that one).
That gave me a long exception and the package update failed:
Failed to execute command 'export LANG=C; apt-get update 2>&1': Ign file: Release.gpg Ign file: Release Ign file: Translation-en Hit http://debian.yeasoft.net wheezy Release.gpg...
http://ppa.launchpad.net/jcfp/ppa/ubuntu/dists/$(lsb_release/-s)/binary-amd64/Packages 404 Not Found E: Some index files failed to download. They have been ignored, or old ones used instead.
Error #4000:
exception 'OMVException' with message 'Failed to execute command 'export LANG=C; apt-get update 2>&1': Ign file: Release.gpg
(so long in fact that I had to use pastebin for the rest of the exception):
http://pastebin.com/3KsHMHvh

Not sure how to clean up the environment to fix this.

But whats worse is that after the update and restart, ZFS has stopped working and all I get is this:

The ZFS modules are not loaded. Try running '/sbin/modprobe zfs' as root to load them.
Error #0:
exception 'OMVModuleZFSException' with message 'The ZFS modules are not loaded.
Try running '/sbin/modprobe zfs' as root to load them.' in /usr/share/omvzfs/Utils.php:540
Stack trace:
#0 /usr/share/omvzfs/Utils.php(366): OMVModuleZFSUtil::exec('zfs list -H -t ...', Array, 1)
#1 /usr/share/openmediavault/engined/rpc/zfs.inc(206): OMVModuleZFSUtil::getZFSFlatArray()
#2 [internal function]: OMVRpcServiceZFS->getObjectTree(Array, Array)
#3 /usr/share/php/openmediavault/rpcservice.inc(125): call_user_func_array(Array, Array)
#4 /usr/share/php/openmediavault/rpc.inc(79): OMVRpcServiceAbstract->callMethod('getObjectTree', Array, Array)
#5 /usr/sbin/omv-engined(500): OMVRpc::exec('ZFS', 'getObjectTree', Array, Array, 1)
#6 {main}

"modprobe zfs" just gave another error:
:~# /sbin/modprobe zfs
ERROR: could not insert 'zfs': Invalid argument

If I look at installed plugins, zfs is present, but I guess it is in a bad state.

I need to fix both problems, but the ZFS issue is the most important, but I suspect they are related in some way.
I really hope that @raulfg3 or someone else have some ideas here.

Would it be a good idea to uninstall and reinstall the ZFS-plugin?

By the way. The forum is incredibly slow today. Is there a problem?

Thanks. I probably used a tutorial, yes. Removed that line from sources.list, hopefully it will work better next time.

The line "ts/$(lsb_release/-c/binary-a" is part of the repo for Sabnzbd 8.0 that worked earlier.
I removed that, hopefully OMV have v8 now.

After these steps I get no errors when I check for updates.

The OS is installed on an old 80Gb IDE-disc. Might be coming to its EOL.
The S.M.A.R.T tab reports that there are a few bad sectors.
What tool is best to use on OMV to restore data from, handle and ignore the bad blocks (until I can switch the disc)?

I have no sata-slots left. Should I move it all to two USB-sticks and use the Flash memory plugin?

Zitat von raulfg3

PD: For your RAM problem:

EMBY is really angry about RAM and grow in each rebuikd of database, so you need to stop and then restart to restore RAM to aceptable values , this must be done one time each 2 or 3 weeks to avoid excesive RAM comsumitio.

It does not seem to release the memory even then, I tried to stop/start the emby service and the EMby itself but it did not release the data as expected. Restart of OMV could be a soultion, I guess. But not as nice.
I use emby to serv my Kodi with info and to serve my daughter out of town and it works well..

Zitat von raulfg3

ZFS is angry about RAM , but you can limit RAM use , with variables, see my ZFS post, and limit your ZFS RAM usage to 4GB max (I assume that you have 8GB):
[HOWTO] Instal ZFS-Plugin & use ZFS on OMV

I did that and as long as emby behaves the ram consumption is OK. ZFS was my first suspect, but I have turned my eyes to emby now, as that seems more likely.[/quote]

Bad sectors seems to be the cause right now, can I retrieve and temporary save my system to get it running for a couple of days until I can get a new install in place?

Did a reinstall on a USB-drive and added the Flash Memory plugin first thing.

But since I imported the ZFS pools, they have dropped off the grid at least twice. They reappear when I do a new import, but I really do not like the trend...
Edit: Just restarted the system and the ZFS pools was gone again. It seems they are not saved correctly (for aouto mount).

And one of the pool is reported as Status: OK but Degraded.
It was OK before, might this be some effect after the bad sector problem of the old drive?
Can I just wipe it and add it again with replace?

pool: ior
 state: DEGRADED
status: One or more devices could not be used because the label is missing or
    invalid.  Sufficient replicas exist for the pool to continue
    functioning in a degraded state.
action: Replace the device using 'zpool replace'.
   see: http://zfsonlinux.org/msg/ZFS-8000-4J
  scan: scrub repaired 0 in 3h1m with 0 errors on Mon Apr 25 07:23:45 2016
config:


    NAME                     STATE     READ WRITE CKSUM
    ior                      DEGRADED     0     0     0
      mirror-0               DEGRADED     0     0     0
        sda                  ONLINE       0     0     0
        7679384661824487182  FAULTED      0     0     0  was /dev/sde1


errors: No known data errors

By the way, it would be great to have some indicator on the zfs-tab that there is something going on. I started a scrub to see if that would help, but never saw any clear indication for progress.
The status report showed that the scrub was running though.

Edit. Great to have the site back in full speed again after the short downtime!
New Edit, adding @raulfg3 here as I suspect he is the best one to answer this...

Zitat von raulfg3

Perhaps is a problem with USB plugin, to be sure, the best is to do a new fresh install an a new IDE old disk that do not have pending sectors.

I will install it on a WD SATA 250Gb connected with USB instead of a flash drive. I did a new clean install btw, I did not try to restore it (other than some folders). I wish to move that job a couple of days forward though. Have too much other stuff to do rigt now. And it is GoT season again...

Zitat von raulfg3

My suspect is bad sata cables or something related to cables or cages, do you use hot-plug cages to connect your SATA Disk?, if yes, try to use direct sata conexion to your board, in the past I have experience simmilar problems ( disk that suddenly dissapear), and thje problem was a hot-plug cages for my data HD .

Revise cable connexion, and HD temp too, and post your SMART values of your data disk to revise.

No hot plug only sata cables. But I might have loosened it when I removed the power cords to install OMV.

The disc names are switching between restarts, feels odd...
And this time the degraded one was loaded but not the others.

Really should reinstall

Here is the S:M:A:R:T ino on the disc that is set as faulty:

smartctl 5.41 2011-06-09 r3365 [x86_64-linux-3.2.0-4-amd64] (local build)
Copyright (C) 2002-11 by Bruce Allen, http://smartmontools.sourceforge.net


=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red
Device Model:     WDC WD30EFRX-68EUZN0
Serial Number:    WD-WCC4N1EX24FY
LU WWN Device Id: 5 0014ee 20ca77811
Firmware Version: 82.00A82
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   9
ATA Standard is:  Exact ATA specification draft version not indicated
Local Time is:    Mon Apr 25 14:03:55 2016 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled


=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED


General SMART Values:
Offline data collection status:  (0x82)    Offline data collection activity
                    was completed without error.
                    Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)    The previous self-test routine completed
                    without error or no self-test has ever
                    been run.
Total time to complete Offline
data collection:         (40560) seconds.
Offline data collection
capabilities:              (0x7b) SMART execute Offline immediate.
                    Auto Offline data collection on/off support.
                    Suspend Offline collection upon new
                    command.
                    Offline surface scan supported.
                    Self-test supported.
                    Conveyance Self-test supported.
                    Selective Self-test supported.
SMART capabilities:            (0x0003)    Saves SMART data before entering
                    power-saving mode.
                    Supports SMART auto save timer.
Error logging capability:        (0x01)    Error logging supported.
                    General Purpose Logging supported.
Short self-test routine
recommended polling time:      (   2) minutes.
Extended self-test routine
recommended polling time:      ( 255) minutes.
Conveyance self-test routine
recommended polling time:      (   5) minutes.
SCT capabilities:            (0x703d)    SCT Status supported.
                    SCT Error Recovery Control supported.
                    SCT Feature Control supported.
                    SCT Data Table supported.


SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAGS    VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate     POSR-K   200   200   051    -    0
  3 Spin_Up_Time            POS--K   187   187   021    -    5633
  4 Start_Stop_Count        -O--CK   100   100   000    -    8
  5 Reallocated_Sector_Ct   PO--CK   200   200   140    -    0
  7 Seek_Error_Rate         -OSR-K   200   200   000    -    0
  9 Power_On_Hours          -O--CK   098   098   000    -    1909
 10 Spin_Retry_Count        -O--CK   100   253   000    -    0
 11 Calibration_Retry_Count -O--CK   100   253   000    -    0
 12 Power_Cycle_Count       -O--CK   100   100   000    -    8
192 Power-Off_Retract_Count -O--CK   200   200   000    -    2
193 Load_Cycle_Count        -O--CK   200   200   000    -    2265
194 Temperature_Celsius     -O---K   119   112   000    -    31
196 Reallocated_Event_Count -O--CK   200   200   000    -    0
197 Current_Pending_Sector  -O--CK   200   200   000    -    0
198 Offline_Uncorrectable   ----CK   200   200   000    -    0
199 UDMA_CRC_Error_Count    -O--CK   200   200   000    -    0
200 Multi_Zone_Error_Rate   ---R--   200   200   000    -    0
                            ||||||_ K auto-keep
                            |||||__ C event count
                            ||||___ R error rate
                            |||____ S speed/performance
                            ||_____ O updated online
                            |______ P prefailure warning

It was too much info for one post. Added the rest on pastebin (if anything there is relevant)

I switched to a new sata cable and after I started, it have started and automated resilver.
So I am a bit impressed with how simple that was.

On the down side, Only one pool, the degraded one, appeared after the restart.
But the others came back after a new import.

As I said, I will reinstall OMV on a proper harddrive, even if it is attached with USB.
Do I need the flash memory plugin for that kind of drive too? Probably not.