Beiträge von chris_kmn

Which kernel are u using now?

I would recommend a nvidia quadro p600-p200 or a quadro t600. They are using less power and are pascal/turing gpu‘s.

You can also check this matrix, wich gpu‘s support what codecs: navida codec matrix

Zitat von molnart

wtf, you serious? thats a serious bummer.

after further testing is looks like always the container last spun up has access to the GPU, the others don't. so far I can occasionally get HW acceleration for Plex and Ollama, but its pretty unpredictable which one can actually use it. and additionally i wanted to play around with fooocus image generation...

so i guess my only option is to to move my GPU apps to separate LXC containers, as there seems to be a way how to share the GPU between multiple LXCs

I‘m not 100% sure, but I con only run one container with one GPU and I‘ve read about that somewhere. So it seems to be valid.

May be there are ways to overcome that issue, but I don‘t know them. Strange thing on my machine is, that Plex ist running together with Tdarr, using the same GPU. But Plex and Handbrake are not able to use the same GPU. So I‘m running Handbrake on the internal GPU (Intel) and Plex on nvidia.

It might be connected to the nvidia container toolkit. It passes the nvidia driver, which is outside of the container, to the docker container. There might be ways to install the nvidia driver inside the container. But I‘ve never done that.

Zitat von molnart

ok, i spoke to soon, drivers are installed, GPU should be visible inside docker containers as confirmed by

Code

docker run --rm --runtime=nvidia --gpus all nvidia/cuda:11.6.2-base-ubuntu20.04 nvidia-smi

i have changed plex and immich settings to utilize HW accel, but it does not work. neither plex or immich utilize the HW acceleration... what else could have i missed?

Hard to say without any information about your installation. In general it is only possible to use one GPU per container. You can not use the same GPU in multiple containers.

HW transcoding will only be used, if the codec of the video can be processed by your GPU. Wich graphics card are you using ?

Zitat von Cap10Canuck

Tried to install the Nvidia drivers again as per the install guide and the install stopped at the following:

"This system has a graphics card which is no longer handled by the NVIDIA driver (package nvidia-driver).

You may wish to keep the package installed - for instance to drive some other card - but the card with the following chipset won't be usable.

06:00.0 VGA compatible controller [0300]: NVIDIA Corporation GK104 [GeForce GTX 760] [10de:1187] (rev a1)

The above card requires either the non-free legacy NVIDIA driver (package nvidia-tesla-470-driver) or the free Nouveau driver (package xserver-xorg-video-nouveau). Use the update-glx command to switch between different installed drivers. │

Before the Nouveau driver can be used you must remove NVIDIA configuration from xorg.conf (and xorg.conf.d/)."

At this point I may just throw in the towel, given it errored-out at only step 3 of a relatively complex set of installation instructions.

Alles anzeigen

Cap10Canuck:

If you really want to use such an old graphics card (in my opinion there won’t be a big benefit) you can follow this instructions to install the correct nvidia driver:

NvidiaGraphicsDrivers - Debian Wiki

Then proceed the tutorial after the nvidia driver part. But I‘ve never tried using the legacy drivers.

For me it would make more sense to get a used nvidia quadro p600 or p1000 wich is consuming way less power and has way more video performance.

I haven‘t had any issues with upgrading to omv7 - but I followed a tutorial that was posted somewhere here in the forum for upgrading from 6 -> 7.

And yes, omv7 with debian 12 uses nvidia 5xx drivers.

For me too, but plex is not hw-transcoding with that driver. As far as I remeber you are not using plex, right Nefertiti ?

The 550 driver is not working - at least on my system. Plex is not hw-transcoding. The latest stable nvidia driver on debian 12/bookworm is the 525 version.

Hm, I didn’t run into that issue until now.

Does it work if you leave out the xconfig part?

Or may be it helps if you uninstall nvidia-xconfig with purge parameter and reinstall it ?

apt-get remove nvidia-xconfig —purge

Zitat von molnart

switching to pve kernel allows to install the nvidia drivers without error, but i run into issues with sudo nvidia-xconfig - it does not find the GPU:

Code

$ sudo nvidia-xconfig

Using X configuration file: "/etc/X11/xorg.conf".

VALIDATION ERROR: Data incomplete in file /etc/X11/xorg.conf.
                  Device section "Device0" must have a Driver line.


WARNING: error opening libnvidia-cfg.so.1: libnvidia-cfg.so.1: cannot open shared object file: No such file or
         directory.


ERROR: Unable to find any GPUs in the system.

Backed up file '/etc/X11/xorg.conf' as '/etc/X11/xorg.conf.nvidia-xconfig-original'
Backed up file '/etc/X11/xorg.conf' as '/etc/X11/xorg.conf.backup'
New X configuration file written to '/etc/X11/xorg.conf'

Alles anzeigen

although in lspci i can clearly see the device

02:00.0 3D controller: NVIDIA Corporation GP104GL [Tesla P4] (rev a1)

I am using the pve kernels. They do work fine. Try to switch to the pve kernel and enable the backports repositories.

Wich kernel are you using on omv7 ? Do you use the proxmox-kernel ? And did you try to remove old nvidia packages ? For me it seem that there are some older dependencies

nsas02 you should stick to the versions that are provided with the repositories. OMV6 / Debian 11 comes with nvidia 4xx drivers, OMV7 / Debian 12 comes with nvidia 5xx drivers. There is no difference in my tutorial for 4xx and 5xx drivers.

Zitat von bbddpp

OMV6 wants to install a bunch of nvidia package updates today. I recall this breaks any custom installation of nvidia hardware accelerated drivers. Is there a list of packages we need to keep back?

I can not confirm, that the update is breaking earlier installations, as long as you have installed the drivers from the debian repository.

Zitat von Tallboi

I started from a fresh install of OMV 6 and the GPU did show up in my embyserver under transcoding and just last night when I checking on on things with my emby server I went to transcoding and I didn't see my GPU listed there.

Question is if the „fresh install“ already has docker compose. That’s why I‘m asking if you upgraded from the latest OMV6 version

How about installing nvidia-driver and nvidia toolkit one more time ? Did you notice the change in the docker setup for nvidia driver under compose ? -> Step 5 in my guide:

Guide

Nvidia-smi is showing, that the driver is installed and working.

Have you had the latest version of OMV 6 bevor you upgraded to ?

And did the video transcode before the upgrade or is it another video ? Your „old“ GTX 1050 doesn‘t support many codecs….

And you could check, if OMV 7 is offering an update of the nvidia-driver, as debian 12 supports nvidia 5.xxx driver versions.

I just did it two days ago (to OMV 7). Went smooth. No problems with nvidia drivers on my machine.

If you have already updated to docker compose it should work fine.

I‘m using the linuxserver-plex container:

linuxserver/plex

BUT, officially the 5xx nvidia drivers are not supported/released for debian. I‘m sticking with the 4xx drivers.

Zitat von fbeye

Ohhh Crap! My new drivers installed but now Plex is all weird!!!!

nvidia-smi;

Code

+---------------------------------------------------------------------------------------+
| NVIDIA-SMI 535.104.12             Driver Version: 535.104.12   CUDA Version: N/A      |
|-----------------------------------------+----------------------+----------------------+
| GPU  Name                 Persistence-M | Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp   Perf          Pwr:Usage/Cap |         Memory-Usage | GPU-Util  Compute M. |
|                                         |                      |               MIG M. |
|=========================================+======================+======================|
|   0  Quadro P400                    Off | 00000000:37:00.0 Off |                  N/A |
| 42%   48C    P0              N/A /  N/A |      0MiB /  2048MiB |      1%      Default |
|                                         |                      |                  N/A |
+-----------------------------------------+----------------------+----------------------+

+---------------------------------------------------------------------------------------+
| Processes:                                                                            |
|  GPU   GI   CI        PID   Type   Process name                            GPU Memory |
|        ID   ID                                                             Usage      |
|=======================================================================================|
|  No running processes found                                                           |
+---------------------------------------------------------------------------------------+

Alles anzeigen

Trying to start Plex;

Code

failed to deploy a stack: Container plex Creating Container plex Created Container plex Starting Error response from daemon: could not select device driver "" with capabilities: [[gpu]] 

Compose;

Code

version: "3.8"
services:
  plex:
    image: plexinc/pms-docker:plexpass
    mem_limit: 64G
    container_name: plex
    network_mode: host
    deploy:
      resources:
        reservations:
          devices:
            - capabilities: [gpu]
    environment:
      - PUID=1000
      - PGID=100
      - VERSION=plexpass
      - NVIDIA_VISIBLE_DEVICES=all
      - NVIDIA_DRIVER_CAPABILITIES=compute,video,utility
    volumes:
      - /srv/remotemount/NAS/Server:/tv
      - /srv/dev-disk-by-uuid-49fe686e-e61f-451b-94f3-f11f9df5625c/containers/plex:/config
      - /srv/dev-disk-by-uuid-49fe686e-e61f-451b-94f3-f11f9df5625c/Server:/media
      - /srv/dev-disk-by-uuid-49fe686e-e61f-451b-94f3-f11f9df5625c/Server/tmp:/tmp
      - /srv/dev-disk-by-uuid-49fe686e-e61f-451b-94f3-f11f9df5625c/Server/tmp:/transcode
    restart: unless-stopped

Alles anzeigen

The compose has always been as such.

Alles anzeigen

chente

If I got it right you want me to add a text to this passage:

…………………………………………………………………………………………………………………………………………………

Docker

• In this section you can define the docker installation folder. This is useful for getting docker off the OMV system disk. The default path is /var/lib/docker.

• In the Docker Storage field define the path of the folder you want to use to install Docker.
  • Avoid using symlinks in this field.
• Click Reinstall Docker button. Docker is now installed in the new path.

…………………………………………………………………………………………………………………………………………………

My proposal would be as following:

• If you are using nvidia drivers in your docker containers (e.g. for Plex or Jellyfin hardware transcoding) you have to leave the path blank. If not, the nvidia driver settings are getting corrupted each time you reconfigure the OMV settings.

Do you think that is sufficient? You could of course add a link to my tutorial.

Best, Chris

Zitat von chente

chris_kmn

I would like to add a note on this topic to the wiki in this section. https://wiki.omv-extras.org/do…ins:docker_compose#docker

I have never used an Nvidia card nor do I plan to do so soon, so I'm not sure how to write this so it is understood correctly.

Since you are the creator of that guide that is helping so many people on the forum, I consider that you are the best prepared to propose that text.

I would appreciate it if you could contribute a suggestion for writing this.

A couple of sentences would be enough, or whatever you consider, there is no problem of space.

I'll probably add a link to your guide too, with your permission.

Alles anzeigen

chente :

I‘m going to have a look into it. I think I will be able to provide a text. But I‘m not an english native so I have to see that I do understand everything correctly and get the right message.

Give me some days and I make a proposal.

Cheer, Chris