SnapRAID Not Seeing Data — What do I do?

    • Resolved
    • OMV 3.x
    • SnapRAID Not Seeing Data — What do I do?

      When running snapraid status I get a concerning result.
      Set-up:
      3 simular drives (Toshiba 5TB)
      each are Data and Content members of the same SnapRaid
      each are Branches of the same Union Filesystem

      Concern:
      While UnionFS balances the amount of data on each; SnapRaid reports nearly equal free space, while disregarding used space on one of the drives.

      Need:
      What the heck is happening here?

      Source Code

      1. Files Fragmented Excess Wasted Used Free Use Name
      2. Files Fragments GB GB GB
      3. 215769 0 0 - 1035 3753 22% data5tbToshBakH
      4. 228399 1 11 - 1037 3753 22% data5tbToshCIK
      5. 2 0 0 - 1 3751 0% data5tbToshBakG

      OMV 4.x on intel
    • ajaja wrote:

      each are Data and Content members of the same SnapRaid
      Do you have a parity drive?

      ajaja wrote:

      each are Branches of the same Union Filesystem
      When figuring out snapraid issues, the fact that they are in a mergerfs pool is not important. Both plugins work on top of the filesystem and don't interact with each other.

      ajaja wrote:

      While UnionFS balances the amount of data on each; SnapRaid reports nearly equal free space, while disregarding used space on one of the drives.
      The filesystem tab says the three toshiba drives have the same amount of space used. Therefore, mergerfs is doing its job.

      ajaja wrote:

      What the heck is happening here?
      Post your snapraid.conf config which is in the snapraid config tab.
      omv 4.1.8.2 arrakis | 64 bit | 4.15 proxmox kernel | omvextrasorg 4.1.8
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please read this before posting a question.
      Please don't PM for support... Too many PMs!
    • Thanks

      Parity is a 6TB Seagate.
      I have seen that SnapRaid and mergerFS coexist. It is still a mystery to me yet. Luckily you see that there is 1/3 of my data being ignored by SnapRAID.

      Here is snapraid.conf:

      PHP Source Code

      1. # this file was automatically generated from
      2. # openmediavault Erasmus 3.0.87
      3. # and 'openmediavault-snapraid' 3.7.1
      4. block_size 256
      5. autosave 0
      6. #####################################################################
      7. # OMV-Name: parity6tbSeagate Drive Label: SeagateWG500SE9
      8. parity /srv/dev-disk-by-label-SeagateWG500SE9/snapraid.parity
      9. #####################################################################
      10. # OMV-Name: data5tbToshBakH Drive Label: Tosh47BAKB3HF57D
      11. content /srv/dev-disk-by-label-Tosh47BAKB3HF57D/snapraid.content
      12. disk data5tbToshBakH /srv/dev-disk-by-label-Tosh47BAKB3HF57D
      13. #####################################################################
      14. # OMV-Name: data5tbToshCIK Drive Label: Tosh47CIK5P7F57D
      15. content /srv/dev-disk-by-label-Tosh47CIK5P7F57D/snapraid.content
      16. disk data5tbToshCIK /srv/dev-disk-by-label-Tosh47CIK5P7F57D
      17. #####################################################################
      18. # OMV-Name: data5tbToshBakG Drive Label: Tosh47BAKB3GF57D
      19. content /srv/dev-disk-by-label-Tosh47BAKB3GF57D/snapraid.content
      20. disk data5tbToshBakG /srv/dev-disk-by-label-Tosh47BAKB3GF57D
      21. exclude *.bak
      22. exclude *.unrecoverable
      23. exclude /tmp/
      24. exclude lost+found/
      25. exclude .content
      26. exclude aquota.group
      27. exclude aquota.user
      28. exclude snapraid.conf*
      29. # Rule selected from /srv/dev-disk-by-label-Tosh47CIK5P7F57D
      30. exclude /plexBackUp/
      31. # Rule selected from /srv/18400f7a-907d-4423-bf76-61047c2ce3f8
      32. exclude /TimeMachine/
      33. # Rule selected from /srv/18400f7a-907d-4423-bf76-61047c2ce3f8
      34. exclude /DownLoader/
      35. # Rule selected from /srv/18400f7a-907d-4423-bf76-61047c2ce3f8
      36. exclude /plexmediaserver/
      37. # Rule selected from /srv/18400f7a-907d-4423-bf76-61047c2ce3f8
      38. exclude /plexTMP/
      Display All
      OMV 4.x on intel
    • WOW!
      Most of the excluded data is on that one drive. Sure that that will change over time.

      Thanks for getting me to the configuration file.

      How do I mark 'Solved'


      Python Source Code

      1. root@baseOMV:~# du -sh /srv/dev-disk-by-label-Tosh47BAKB3GF57D/*
      2. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3GF57D/DownLoader
      3. 1.6G /srv/dev-disk-by-label-Tosh47BAKB3GF57D/Media
      4. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3GF57D/plexTMP
      5. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3GF57D/Quarantine
      6. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3GF57D/snapraid.conf
      7. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3GF57D/snapraid.conf.bak
      8. 179M /srv/dev-disk-by-label-Tosh47BAKB3GF57D/snapraid.content
      9. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3GF57D/Stuff
      10. 1.1T /srv/dev-disk-by-label-Tosh47BAKB3GF57D/TimeMachine
      11. root@baseOMV:~# du -sh /srv/dev-disk-by-label-Tosh47BAKB3HF57D/*
      12. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3HF57D/DownLoader
      13. 731G /srv/dev-disk-by-label-Tosh47BAKB3HF57D/Media
      14. 1.9M /srv/dev-disk-by-label-Tosh47BAKB3HF57D/plexBackUp
      15. 9.7G /srv/dev-disk-by-label-Tosh47BAKB3HF57D/plexmediaserver
      16. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3HF57D/plexPy
      17. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3HF57D/plexTMP
      18. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3HF57D/snapraid.conf
      19. 4.0K /srv/dev-disk-by-label-Tosh47BAKB3HF57D/snapraid.conf.bak
      20. 179M /srv/dev-disk-by-label-Tosh47BAKB3HF57D/snapraid.content
      21. 0 /srv/dev-disk-by-label-Tosh47BAKB3HF57D/snapraid.content.lock
      22. 235G /srv/dev-disk-by-label-Tosh47BAKB3HF57D/Stuff
      23. 156G /srv/dev-disk-by-label-Tosh47BAKB3HF57D/TimeMachine
      24. root@baseOMV:~# du -sh /srv/dev-disk-by-label-Tosh47CIK5P7F57D/*
      25. 4.0K /srv/dev-disk-by-label-Tosh47CIK5P7F57D/DownLoader
      26. 16K /srv/dev-disk-by-label-Tosh47CIK5P7F57D/lost+found
      27. 729G /srv/dev-disk-by-label-Tosh47CIK5P7F57D/Media
      28. 464K /srv/dev-disk-by-label-Tosh47CIK5P7F57D/plexBackUp
      29. 4.0K /srv/dev-disk-by-label-Tosh47CIK5P7F57D/plexTMP
      30. 4.0K /srv/dev-disk-by-label-Tosh47CIK5P7F57D/snapraid.conf
      31. 4.0K /srv/dev-disk-by-label-Tosh47CIK5P7F57D/snapraid.conf.bak
      32. 179M /srv/dev-disk-by-label-Tosh47CIK5P7F57D/snapraid.content
      33. 239G /srv/dev-disk-by-label-Tosh47CIK5P7F57D/Stuff
      34. 157G /srv/dev-disk-by-label-Tosh47CIK5P7F57D/TimeMachine
      Display All
      OMV 4.x on intel
    • ajaja wrote:

      How do I mark 'Solved'
      edit the thread and add the "resolved" tag.
      omv 4.1.8.2 arrakis | 64 bit | 4.15 proxmox kernel | omvextrasorg 4.1.8
      omv-extras.org plugins source code and issue tracker - github.com/OpenMediaVault-Plugin-Developers

      Please read this before posting a question.
      Please don't PM for support... Too many PMs!