Issues with portainer after running iptables -F

muchgooder · 11. Februar 2022

I've had an issue form another thread where I can't pass any ports to any docker containers from the outside. Through the course of several days and a lot of help it became clear that the issue was related to docker in general and iptables specifically.

I wandered over to the docker forum and they recommended that - after backing up my configuration - I run iptables -F to wipe out whatever was in the iptables. I did so and then manually rebooted OMV.

After the first reboot docker reported that it had loaded but portainer said it was not installed. Ok, I clicked install, let it install and then rebooted.

When it came back it reported that docker was running and portainer was status "created". I rebooted again - nb luck, still stuck on "created". What should I do here? My containers are running.

(side note - it did not appear that flushing iptables fixed my original issue as I still can't pass ports to a docker container running on omv).

Zoki · 11. Februar 2022

iptables -F is temporary until the next boot, so has nothing to do with your problem. Here are the docs: https://linux.die.net/man/8/iptables

Not having an OMV in front of me, what is your problem? Can you access portainer on the given port?

If not, you have to use the cli and do docker ps -a to get the list of containers and an docker logs -f portainer to get the logs from portainer.

muchgooder · 11. Februar 2022

Zitat von Zoki

iptables -F is temporary until the next boot, so has nothing to do with your problem. Here are the docs: https://linux.die.net/man/8/iptables

Not having an OMV in front of me, what is your problem? Can you access portainer on the given port?

If not, you have to use the cli and do docker ps -a to get the list of containers and an docker logs -f portainer to get the logs from portainer.

Thank you so much for this. I clicked on "Install" again for Portainer and now it tells me that it is running.

However, after waiting a few minutes it still isn't available in the UI. Here are the logs:

Code

root@HAL:~# docker logs -f portainer
INFO 2022/02/11 13:42:53 Encryption key file `portainer` not present
INFO 2022/02/11 13:42:53 Proceeding without encryption key
INFO 2022/02/11 13:42:53 Loading PortainerDB: portainer.db
INFO 2022/02/11 13:42:55 Opened existing store
2022/02/11 13:42:55 server: Reverse tunnelling enabled
2022/02/11 13:42:55 server: Fingerprint <fingerprint removed>
2022/02/11 13:42:55 server: Listening on 0.0.0.0:8000...
level=info msg="2022/02/11 13:42:55 [DEBUG] [chisel, monitoring] [check_interval_seconds: 10.000000] [message: starting tunnel management process]"
INFO 2022/02/11 13:42:55 [INFO] [cmd,main] Starting Portainer version 2.11.1


level=info msg="2022/02/11 13:42:55 [DEBUG] [internal,init] [message: start initialization monitor ]"
level=info msg="2022/02/11 13:42:55 [INFO] [http,server] [message: starting HTTPS server on port :9443]"
level=info msg="2022/02/11 13:42:55 [INFO] [http,server] [message: starting HTTP server on port :9000]"

Alles anzeigen

As you may recall, a couple of weeks ago you were helping to debug the issue of why I can't forward ports to docker containers. At your urging I went over to the docker forum and one of the mods urged me to run iptables -F. I ran it again a minute ago without rebooting - the port forwarding issue still seems to persist.

Zoki · 11. Februar 2022

It claims to be listening on port 9000.

docker inspect portainer please

muchgooder · 11. Februar 2022

Zitat von Zoki

It claims to be listening on port 9000.

docker inspect portainer please

sure, thank you again

Code

[
{
"Id": "302611ea395f00c16cd23e2cfd19ed2abb1cef2d23cf64d97e05462168d41a02",
"Created": "2022-02-11T13:42:49.00339282Z",
"Path": "/portainer",
"Args": [],
"State": {
"Status": "running",
"Running": true,
"Paused": false,
"Restarting": false,
"OOMKilled": false,
"Dead": false,
"Pid": 26042,
"ExitCode": 0,
"Error": "",
"StartedAt": "2022-02-11T13:42:51.327613454Z",
"FinishedAt": "0001-01-01T00:00:00Z"
},
"Image": "sha256:ed396c816a7560eecd27dd3bc06b60912badaef223238d82c1741d7d3626a039",
"ResolvConfPath": "/srv/dev-disk-by-label-Docker/Docker/containers/302611ea395f00c16cd23e2cfd19ed2abb1cef2d23cf64d97e05462168d41a02/resolv.conf",
"HostnamePath": "/srv/dev-disk-by-label-Docker/Docker/containers/302611ea395f00c16cd23e2cfd19ed2abb1cef2d23cf64d97e05462168d41a02/hostname",
"HostsPath": "/srv/dev-disk-by-label-Docker/Docker/containers/302611ea395f00c16cd23e2cfd19ed2abb1cef2d23cf64d97e05462168d41a02/hosts",
"LogPath": "/srv/dev-disk-by-label-Docker/Docker/containers/302611ea395f00c16cd23e2cfd19ed2abb1cef2d23cf64d97e05462168d41a02/302611ea395f00c16cd23e2cfd19ed2abb1cef2d23cf64d97e05462168d41a02-json.log",
"Name": "/portainer",
"RestartCount": 0,
"Driver": "overlay2",
"Platform": "linux",
"MountLabel": "",
"ProcessLabel": "",
"AppArmorProfile": "docker-default",
"ExecIDs": null,
"HostConfig": {
"Binds": [
"/var/run/docker.sock:/var/run/docker.sock",
"portainer_data:/data"
],
"ContainerIDFile": "",
"LogConfig": {
"Type": "json-file",
"Config": {}
},
"NetworkMode": "default",
"PortBindings": {
"8000/tcp": [
{
"HostIp": "",
"HostPort": "8000"
}
],
"9000/tcp": [
{
"HostIp": "",
"HostPort": "9000"
}
]
},
"RestartPolicy": {
"Name": "unless-stopped",
"MaximumRetryCount": 0
},
"AutoRemove": false,
"VolumeDriver": "",
"VolumesFrom": null,
"CapAdd": null,
"CapDrop": null,
"CgroupnsMode": "host",
"Dns": [],
"DnsOptions": [],
"DnsSearch": [],
"ExtraHosts": null,
"GroupAdd": null,
"IpcMode": "private",
"Cgroup": "",
"Links": null,
"OomScoreAdj": 0,
"PidMode": "",
"Privileged": false,
"PublishAllPorts": false,
"ReadonlyRootfs": false,
"SecurityOpt": null,
"UTSMode": "",
"UsernsMode": "",
"ShmSize": 67108864,
"Runtime": "runc",
"ConsoleSize": [
0,
0
],
"Isolation": "",
"CpuShares": 0,
"Memory": 0,
"NanoCpus": 0,
"CgroupParent": "",
"BlkioWeight": 0,
"BlkioWeightDevice": [],
"BlkioDeviceReadBps": null,
"BlkioDeviceWriteBps": null,
"BlkioDeviceReadIOps": null,
"BlkioDeviceWriteIOps": null,
"CpuPeriod": 0,
"CpuQuota": 0,
"CpuRealtimePeriod": 0,
"CpuRealtimeRuntime": 0,
"CpusetCpus": "",
"CpusetMems": "",
"Devices": [],
"DeviceCgroupRules": null,
"DeviceRequests": null,
"KernelMemory": 0,
"KernelMemoryTCP": 0,
"MemoryReservation": 0,
"MemorySwap": 0,
"MemorySwappiness": null,
"OomKillDisable": false,
"PidsLimit": null,
"Ulimits": null,
"CpuCount": 0,
"CpuPercent": 0,
"IOMaximumIOps": 0,
"IOMaximumBandwidth": 0,
"MaskedPaths": [
"/proc/asound",
"/proc/acpi",
"/proc/kcore",
"/proc/keys",
"/proc/latency_stats",
"/proc/timer_list",
"/proc/timer_stats",
"/proc/sched_debug",
"/proc/scsi",
"/sys/firmware"
],
"ReadonlyPaths": [
"/proc/bus",
"/proc/fs",
"/proc/irq",
"/proc/sys",
"/proc/sysrq-trigger"
]
},
"GraphDriver": {
"Data": {
"LowerDir": "/srv/dev-disk-by-label-Docker/Docker/overlay2/9840d445ed70847fa1cb62abee4ab4055f5944cd98951fa5523a11200cc2f76a-init/diff:/srv/dev-disk-by-label-Docker/Docker/overlay2/1d0424b975bf2dd6c475e4e5c36ad43912d4cdc1a9b8445bac8c9eeed4619242/diff:/srv/dev-disk-by-label-Docker/Docker/overlay2/8f41b0bb5d4b0a8622d8b910df02e4632b98347e3b2b30f9733d9eeff6821d1d/diff:/srv/dev-disk-by-label-Docker/Docker/overlay2/c379e9d296074329ec7ac8980751f0c2d4b5b56c1629e2bce670375fd059f1f7/diff",
"MergedDir": "/srv/dev-disk-by-label-Docker/Docker/overlay2/9840d445ed70847fa1cb62abee4ab4055f5944cd98951fa5523a11200cc2f76a/merged",
"UpperDir": "/srv/dev-disk-by-label-Docker/Docker/overlay2/9840d445ed70847fa1cb62abee4ab4055f5944cd98951fa5523a11200cc2f76a/diff",
"WorkDir": "/srv/dev-disk-by-label-Docker/Docker/overlay2/9840d445ed70847fa1cb62abee4ab4055f5944cd98951fa5523a11200cc2f76a/work"
},
"Name": "overlay2"
},
"Mounts": [
{
"Type": "bind",
"Source": "/var/run/docker.sock",
"Destination": "/var/run/docker.sock",
"Mode": "",
"RW": true,
"Propagation": "rprivate"
},
{
"Type": "volume",
"Name": "portainer_data",
"Source": "/srv/dev-disk-by-label-Docker/Docker/volumes/portainer_data/_data",
"Destination": "/data",
"Driver": "local",
"Mode": "z",
"RW": true,
"Propagation": ""
}
],
"Config": {
"Hostname": "302611ea395f",
"Domainname": "",
"User": "",
"AttachStdin": false,
"AttachStdout": false,
"AttachStderr": false,
"ExposedPorts": {
"8000/tcp": {},
"9000/tcp": {},
"9443/tcp": {}
},
"Tty": false,
"OpenStdin": false,
"StdinOnce": false,
"Env": [
"PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin"
],
"Cmd": null,
"Image": "portainer/portainer-ce",
"Volumes": {
"/data": {}
},
"WorkingDir": "/",
"Entrypoint": [
"/portainer"
],
"OnBuild": null,
"Labels": {}
},
"NetworkSettings": {
"Bridge": "",
"SandboxID": "cd057152d2865dab928c0a3c8df23647e368af25457685c464d42e71c567c834",
"HairpinMode": false,
"LinkLocalIPv6Address": "",
"LinkLocalIPv6PrefixLen": 0,
"Ports": {
"8000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "8000"
},
{
"HostIp": "::",
"HostPort": "8000"
}
],
"9000/tcp": [
{
"HostIp": "0.0.0.0",
"HostPort": "9000"
},
{
"HostIp": "::",
"HostPort": "9000"
}
],
"9443/tcp": null
},
"SandboxKey": "/var/run/docker/netns/cd057152d286",
"SecondaryIPAddresses": null,
"SecondaryIPv6Addresses": null,
"EndpointID": "adf79b861702479c6d9f3e145f4d56eabbf0ba6d8906acc36142f29ea8900a62",
"Gateway": "172.17.0.1",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"IPAddress": "172.17.0.5",
"IPPrefixLen": 16,
"IPv6Gateway": "",
"MacAddress": "02:42:ac:11:00:05",
"Networks": {
"bridge": {
"IPAMConfig": null,
"Links": null,
"Aliases": null,
"NetworkID": "b45da7b8910b1c7e6d969e2882c6028547ab30ed7a3935aa4dc0e109ed483426",
"EndpointID": "adf79b861702479c6d9f3e145f4d56eabbf0ba6d8906acc36142f29ea8900a62",
"Gateway": "172.17.0.1",
"IPAddress": "172.17.0.5",
"IPPrefixLen": 16,
"IPv6Gateway": "",
"GlobalIPv6Address": "",
"GlobalIPv6PrefixLen": 0,
"MacAddress": "02:42:ac:11:00:05",
"DriverOpts": null
}
}
}
}
]

Alles anzeigen

Zoki · 11. Februar 2022

This looks pretty normal, the only thing which is different to my setup is that the ports are bound to IPv6 addresses too.

Do you have IPv6 enabled on OMV, if yes it may be worth a try to disable that.

muchgooder · 12. Februar 2022

So I uninstalled it and reinstalled a couple of times and then it kicked in and has been fine ever since. I still have the bigger issue - as soon as I load docker I can't foward ports to OMV itself or to docker containers. Anyway, thanks again for your help.

Zoki · 12. Februar 2022

Don't you think that is related? Portainer is just an ordinary container like the others, nothing special about it.

If you can access portainer on port 9000, the same should be possible for other containers.

muchgooder · 12. Februar 2022

Zitat von Zoki

Don't you think that is related? Portainer is just an ordinary container like the others, nothing special about it.
If you can access portainer on port 9000, the same should be possible for other containers.

No, sorry - I think I confused you with my two different issues. In this issue I was only hoping to get portainer running again, which I have. I casually mentioned my other ongoing issue: docker is somehow spoiling port forwarding to docker containers or OMV itself.

Issues with portainer after running iptables -F

muchgooder 12. Februar 2022

Jetzt mitmachen!

Tags