How to setup Nvidia in Plex docker for hardware transcoding?

Kreavan · 25. Februar 2020

I'm adding an Nvidia Quadro p2000 card to my NAS and would like to know how I can implement that into my Plex docker for hardware transcoding. Can it be added to an existing Plex docker, or do I have to create a whole new one?

I followed the video from Techno Dad Life on creating the Plex Docker using the OMV docker creation GUI. https://www.youtube.com/watch?v=BNfk7ji4oh4

I've not had any luck finding any videos on how to include Nvidia GPU though. Can anyone please help?

Thank you!

macom · 25. Februar 2020

This

"Hardware acceleration users for Nvidia will need to install the container runtime provided by Nvidia on their host, instructions can be found here:
https://github.com/NVIDIA/nvidia-docker"

is from here:
https://hub.docker.com/r/linuxserver/plex

Maybe it helps.

austinalex23 · 3. März 2020

Zitat von Kreavan

I'm adding an Nvidia Quadro p2000 card to my NAS and would like to know how I can implement that into my Plex docker for hardware transcoding. Can it be added to an existing Plex docker, or do I have to create a whole new one?

I followed the video from Techno Dad Life on creating the Plex Docker using the OMV docker creation GUI. https://www.youtube.com/watch?v=BNfk7ji4oh4

I've not had any luck finding any videos on how to include Nvidia GPU though. Can anyone please help?

Thank you!

Alles anzeigen

I've been at it for 4-5 days and am having no luck. (OMV 5).

Zitat von macom

This

"Hardware acceleration users for Nvidia will need to install the container runtime provided by Nvidia on their host, instructions can be found here:
https://github.com/NVIDIA/nvidia-docker"

is from here:
https://hub.docker.com/r/linuxserver/plex

Maybe it helps.

Alles anzeigen

That's where I started too.

I've had a terrible time just installing Nvidia graphics drivers well enough for the docker runtime to work. I have a Reddit post looking for help, which is a sequel to a previous post (put in a handful of spots) that hasn't bore any fruit.

tama777 · 26. März 2020

My Openmediavault System is OMV5.3.9-1 with Linux 5.4.0-0.bpo.-amd64 kernel and NVIDIA GeForce GTX1660. Plex hardware transcoding works for me based on the following (If Plex doesn't hardware transcode, check this video) :

Step 1: Install the NVIDIA driver based on the second option (How to install NVIDIA driver by using the official nvidia.com package step by step instructions).

_{(If you are installing another bpo kernel, you will need to reinstall the Nvidia driver compilation prerequisite: apt -y install linux-headers-$(uname -r) )}

Step 2: Install the Curl command-line utility:

Code

sudo apt install curl

Step 3: Installing the NVIDIA Container Toolkit:

# Add the package repositories

Code

distribution=$(. /etc/os-release;echo $ID$VERSION_ID)
curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey | sudo apt-key add -
curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | sudo tee /etc/apt/sources.list.d/nvidia-docker.list

then

Code

sudo apt-get update && sudo apt-get install -y nvidia-container-toolkit 
sudo systemctl restart docker

Step 4: Installing nvidia-container-runtime:

Code

sudo apt-get install nvidia-container-runtime

Step 5: Edit /etc/nvidia-container-runtime/config.toml eg. nano and replace "@/sbin/ldconfig" with "/sbin/ldconfig", then save the file. (Thanks to lyon667!)

Step 6: If you want NVIDIA to be the default Docker runtime, modify the contents of /etc/docker/daemon.json to:

Code

{
  "runtimes": {
    "nvidia": {
      "path": "/usr/bin/nvidia-container-runtime",
      "runtimeArgs": []
    }
  },
  "default-runtime": "nvidia"
}

Step 7:

Code

sudo systemctl restart docker

Step 8: Install linuxserver/plex

For example, it looks like this to me:

Code

docker create \
  --name=Plex \
  --net=host \
  -e PUID=1000 \
  -e PGID=100 \
  -e VERSION=public \
  -e NVIDIA_VISIBLE_DEVICES=GPU-s96kfsd-3sdf0-g98f-7164-cd76d697872e \
  -e NVIDIA_DRIVER_CAPABILITIES=compute,video,utility \
  -v /srv/dev-disk-by-label-XXXXX/Movies:/Movies \
  -v /srv/dev-disk-by-label-XXXXX/AppData/Plex:/config \
  --restart unless-stopped \
linuxserver/plex

Alles anzeigen

Maybe it helps.

Methy · 26. März 2020

Hello,

just to be sure, do you have a plex license?

https://support.plex.tv/articles/115002178853-using-hardware-accelerated-streaming/

austinalex23 · 27. März 2020

Tama, thank you for the info. I'm going to be reinstalling OMV and giving it another go.

Zitat von Methy

Hello,
just to be sure, do you have a plex license?
https://support.plex.tv/articles/115002178853-using-hardware-accelerated-streaming/

Yes I do have the Plex Pass. My problem is that the Nvidia driver never completely installs correctly so that docker can use the GPU.

austinalex23 · 27. März 2020

Zitat von tama777
My Openmediavault System is OMV5.3.9-1 with Linux 5.4.0-0.bpo.-amd64 kernel and NVIDIA GeForce GTX1660. Plex hardware transcoding works for me based on the following (If Plex doesn't hardware transcode, check this video) :

Step 1: Install the NVIDIA driver based on the second option (How to install NVIDIA driver by using the official nvidia.com package step by step instructions).
_{(If you are installing another bpo kernel, you will need to reinstall the Nvidia driver compilation prerequisite: apt -y install linux-headers-$(uname -r) )}

Step 2: Install the Curl command-line utility:
Code
sudo apt install curl
Step 3: Installing the NVIDIA Container Toolkit:
Code
# Add the package repositories
distribution=$(. /etc/os-release;echo $ID$VERSION_ID)
curl -s -L https://nvidia.github.io/nvidia-docker/gpgkey | sudo apt-key add -
curl -s -L https://nvidia.github.io/nvidia-docker/$distribution/nvidia-docker.list | sudo tee /etc/apt/sources.list.d/nvidia-docker.list

sudo apt-get update && sudo apt-get install -y nvidia-container-toolkit
sudo systemctl restart docker
Step 4: Installing nvidia-container-runtime:
Code
sudo apt-get install nvidia-container-runtime
Step 5: Edit /etc/nvidia-container-runtime/config.toml eg. nano and replace "@ / sbin / ldconfig" with "/ sbin / ldconfig", then save the file. (Thanks to lyon667!)

Step 6: If you want NVIDIA to be the default Docker runtime, modify the contents of /etc/docker/daemon.json to:
Code
{
  "runtimes": {
    "nvidia": {
      "path": "/usr/bin/nvidia-container-runtime",
      "runtimeArgs": []
    }
  },
  "default-runtime": "nvidia"
}
Step 7:
Code
sudo systemctl restart docker
Step 8: Install linuxserver/plex

For example, it looks like this to me:
Code
docker create \
  --name=Plex \
  --net=host \
  -e PUID=1000 \
  -e PGID=100 \
  -e VERSION=public \
  -e NVIDIA_VISIBLE_DEVICES=GPU-s96kfsd-3sdf0-g98f-7164-cd76d697872e \
  -e NVIDIA_DRIVER_CAPABILITIES=compute,video,utility \
  -v /srv/dev-disk-by-label-XXXXX/Movies:/Movies \
  -v /srv/dev-disk-by-label-XXXXX/AppData/Plex:/config \
  --restart unless-stopped \
linuxserver/plex
Alles anzeigen
Maybe it helps.
Alles anzeigen

After following all these steps I get the following error after running the test command for the Nvidia cuda container:

Code

NVIDIA-SMI couldn't find libnvidia-ml.so library in your system. Please make sure that the NVIDIA Display Driver is properly installed and present in your system.
Please also try adding directory that contains libnvidia-ml.so to your system PATH.

Unfortunately this is the same error I got when I first started out trying to get this stuff to work.

FWIW, here is my nvidia-smi output. I have the same driver version as you, which is the latest. Previously I tried a 390 legacy driver but it complained that it was out of date when I ran the cuda container command.

Code

Fri Mar 27 17:03:59 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.64       Driver Version: 440.64       CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 105...  Off  | 00000000:09:00.0 Off |                  N/A |
| 30%   30C    P0    N/A /  75W |      0MiB /  4038MiB |      3%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

Alles anzeigen

tama777 · 27. März 2020

Zitat von austinalex23

After following all these steps I get the following error after running the test command for the Nvidia cuda container:

Code

NVIDIA-SMI couldn't find libnvidia-ml.so library in your system. Please make sure that the NVIDIA Display Driver is properly installed and present in your system.
Please also try adding directory that contains libnvidia-ml.so to your system PATH.

Unfortunately this is the same error I got when I first started out trying to get this stuff to work.

FWIW, here is my nvidia-smi output. I have the same driver version as you, which is the latest. Previously I tried a 390 legacy driver but it complained that it was out of date when I ran the cuda container command.

Code

Fri Mar 27 17:03:59 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 440.64       Driver Version: 440.64       CUDA Version: 10.2     |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|===============================+======================+======================|
|   0  GeForce GTX 105...  Off  | 00000000:09:00.0 Off |                  N/A |
| 30%   30C    P0    N/A /  75W |      0MiB /  4038MiB |      3%      Default |
+-------------------------------+----------------------+----------------------+

+-----------------------------------------------------------------------------+
| Processes:                                                       GPU Memory |
|  GPU       PID   Type   Process name                             Usage      |
|=============================================================================|
|  No running processes found                                                 |
+-----------------------------------------------------------------------------+

Alles anzeigen

What is the contents of /etc/nvidia-container-runtime/config.toml, please copy and paste here.

austinalex23 · 27. März 2020

Zitat von tama777

What is the contents of /etc/nvidia-container-runtime/config.toml, please copy and paste here.

Code

disable-require = false
#swarm-resource = "DOCKER_RESOURCE_GPU"

[nvidia-container-cli]
#root = "/run/nvidia/driver"
#path = "/usr/bin/nvidia-container-cli"
environment = []
#debug = "/var/log/nvidia-container-toolkit.log"
#ldcache = "/etc/ld.so.cache"
load-kmods = true
#no-cgroups = false
#user = "root:video"
ldconfig = "/ sbin / ldconfig"

[nvidia-container-runtime]
#debug = "/var/log/nvidia-container-runtime.log"

Alles anzeigen

tama777 · 27. März 2020

If you fix it so there's no space?

Code

ldconfig = "/sbin/ldconfig"

austinalex23 · 27. März 2020

Zitat von tama777
If you fix it so there's no space?
Code
ldconfig = "/sbin/ldconfig"

Alright now it works! I'll get Plex set up and see how it goes. Thanks again for the help.

tama777 · 27. März 2020

Really nothing, I'm glad it works!

_{I already noticed that, I left the space in my first post! Sorry and I'll fix it!}

austinalex23 · 28. März 2020

Can say that after first trying to get HW transcodes to work over a month ago that last night it actually happened for the first time!

Transcoded streams break on the Windows application and browser but it works fine on the Android and Roku apps but that's not going to ruin my good mood.

MikeDurp · 29. März 2020

So this is what I am getting, what do I do next?

docker: Error response from daemon: OCI runtime create failed: container_linux.g o:349: starting container process caused "process_linux.go:449: container init c aused \"process_linux.go:432: running prestart hook 0 caused \\\"error running h ook: exit status 1, stdout: , stderr: nvidia-container-cli: initialization error : driver error: failed to process request\\\\n\\\"\"": unknown.

ERRO[0026] error waiting for container: context canceled

tama777 · 29. März 2020

Zitat von MikeDurp

So this is what I am getting, what do I do next?

docker: Error response from daemon: OCI runtime create failed: container_linux.g o:349: starting container process caused "process_linux.go:449: container init c aused \"process_linux.go:432: running prestart hook 0 caused \\\"error running h ook: exit status 1, stdout: , stderr: nvidia-container-cli: initialization error : driver error: failed to process request\\\\n\\\"\"": unknown.
ERRO[0026] error waiting for container: context canceled

Login to your system via ssh as root, please run the following command lines separately and paste the results here:

Code

nvidia-smi

Code

docker run --gpus all nvidia/cuda:10.0-base nvidia-smi

tama777 · 29. März 2020

Zitat von austinalex23

Transcoded streams break on the Windows application and browser but it works fine on the Android and Roku apps but that's not going to ruin my good mood.

I think this is a network or client side error and not a hardware transcoding bug because it works on the Android app.

austinalex23 · 1. April 2020

Zitat von tama777

I think this is a network or client side error and not a hardware transcoding bug because it works on the Android app.

Yeah I'm not sure what's going on. Transcode streams don't work at all in Firefox on my laptop or desktop. It kinda works in Edge. Doesn't work on the Plex application, kinda works in the Plex media player application (which I just figured out is different than the Plex application I have been using). Still works pretty perfectly on my Roku TV and phone. Weird stuff.

MikeDurp · 1. April 2020

Zitat von tama777
Login to your system via ssh as root, please run the following command lines separately and paste the results here:
Code
nvidia-smi 
Code
docker run --gpus all nvidia/cuda:10.0-base nvidia-smi

root@openmediavault:~# nvidia-smi

-bash: nvidia-smi: command not found

root@openmediavault:~# docker run --gpus all nvidia/cuda:10.0-base nvidia-smi

Unable to find image 'nvidia/cuda:10.0-base' locally

10.0-base: Pulling from nvidia/cuda

7ddbc47eeb70: Pull complete

c1bbdc448b72: Pull complete

8c3b70e39044: Pull complete

45d437916d57: Pull complete

d8f1569ddae6: Pull complete

de5a2c57c41d: Pull complete

ea6f04a00543: Pull complete

Digest: sha256:e6e1001f286d084f8a3aea991afbcfe92cd389ad1f4883491d43631f152f175e

Status: Downloaded newer image for nvidia/cuda:10.0-base

docker: Error response from daemon: OCI runtime create failed: container_linux.go:349: starting container process caused "process_linux.go:449: container init caused \"process_linux.go:432: running prestart hook 0 caused \\\"error running hook: exit status 1, stdout: , stderr: nvidia-container-cli: initialization error: driver error: failed to process request\\\\n\\\"\"": unknown.

ERRO[0021] error waiting for container: context canceled

tama777 · 2. April 2020

Zitat von MikeDurp

root@openmediavault:~# nvidia-smi
-bash: nvidia-smi: command not found

The NVIDIA driver is not properly installed, please reinstall it!

_{(If you install it properly, we will continue troubleshooting if any!)}

An example (OMV 5 + OMV-Extras + Docker 5:19.03.8~3-0~debian-buster + NVIDIA Linux Graphics Driver v440.64):

Code

apt -y install nvidia-detect

Code

nvidia-detect

Code

wget http://us.download.nvidia.com/XFree86/Linux-x86_64/440.64/NVIDIA-Linux-x86_64-440.64.run

Code

apt -y install linux-headers-$(uname -r) build-essential

Code

echo blacklist nouveau > /etc/modprobe.d/blacklist-nvidia-nouveau.conf

Code

systemctl set-default multi-user.target

Code

systemctl reboot

Code

bash NVIDIA-Linux-x86_64-440.64.run

Code

systemctl set-default graphical.target

Code

systemctl reboot

Code

nvidia-smi

MikeDurp · 5. April 2020

Thank you that worked but I don't see (hw) Transcode for Plex. What do I do next I have Plex setup in docker.

How to setup Nvidia in Plex docker for hardware transcoding?

Jetzt mitmachen!

Tags