K8s issues with data type, kubernetes dashboard + loose thoughts about future proof direction

  • Hello


    I just created an account on the forum today because I was interested in the openmediavault (version 8.x) solution and I started testing it, so the obtained results is on fresh install.


    1. Have detected issues related with data type for port:

    Quote

    kube-system/openmediavault-traefik: Middleware.traefik.io \"https-redirect\" is invalid: spec.redirectScheme.port: Invalid value: \"integer\": spec.redirectScheme.port in body must be of type string: \"integer\""

    Solution: change port number in quotes. I suppose it should be also fixed in code generator.


    2. Second it will be related with kubernetes dashboard, which was retired, see: https://github.com/kubernetes-retired/dashboard and the URL was changed.

    Quote

    E0129 00:14:44.383728 706616 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"helm\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=helm pod=helm-install-kubernetes-dashboard-s6x9f_kube-system(0b2a6409-5cd3-414b-91b7-055dc91a1898)\"" pod="kube-system/helm-install-kubernetes-dashboard-s6x9f" podUID="0b2a6409-5cd3-414b-91b7-055dc91a1898"

    Solution: Probably abandoning the panel and replacing it with a more current and future proof solution.


    3. I just wondering the sense of k3s in the case of single node, because the overhead is quite big although k3s is more lighter than k8s/rke2. In my opinion probably podman is the right and future proof directions here, especially for its rootless and daemon-less nature and many people is shifting from docker -> podman (main reason: security and memory pressure), k3s is for little bigger scale. One thing that is missing in podman plugin is support for compose feature like in compose plugin and we have everything :)


    Anyway the OMV project is really good and useful product. Kudos to everyone involved in its development. I will continue to test and explore the possibilities.

    Thank you!

  • macom

    Approved the thread.
    • Official Post

    1. Thanks for the hint.


    2. Hmmm, that's sad. Didn't monitor every used software in OMV8 every day. So thanks for the hint. I was already thinking about removing the dashboard part from the plugin to allow the user to choose this on his own and use the recipes to install it. Rancher may be an alternative or the suggested Headlamp. For Rancher there is already a recipe available.


    3. Why not using k3s on a single node. It is exactly created and meant for such scenarios.

    I initially worked on the podman plugin, but to be honest, the effort required to start pods automatically after a system reboot is annoying. Somehow, the effort involved is too much for me to deal with. Since my interest has been more focused on Kubernetes lately, I am spending my free time that I have for OMV development in this direction. Kubernetes simply offers a huge ecosystem that also makes sense for single nodes. Since there are Podman, Docker Compose, and K8s plugins, everyone can decide what they want to use. If the community expands the podman plugin with features through contributions, then that's great, of course. That's how an open source project should work. However, I won't be doing anything more for the Podman plugin as I'm focusing on K8s. The Compose plugin is a powerful alternative; you just have to come to terms with Docker.

  • votdev

    Added the Label OMV 8.x
  • I have a different opinion; I see the future in K8s.

    Yes, you are also right about k8s/k3s - it prepares us for future (e.g multi node setup and configuration organization which it on database), but its flexibility and modular architecture adds overhead (layer -> resource cost -> overhead). On my LAB k3s after optimizations was 3-5x "heavier" (means RAM + CPU) than podman without any containers/services.

    Best to have both (or everything) :D But of course preparing/developing plugins consumes a lot of time, so if we must choose only one (and do it as best as possible), for me it will be also k3s (especially since Docker development has slowed down, but still the solution is awesome), so I will be focus on it in my LAB environment ;)


    Huge votdev respect for fast reaction on my issues -> commit are already on github, this is the think, where I really love community!

Participate now!

Don’t have an account yet? Register yourself now and be a part of our community!