help tracking down what is smashing my cpu/load every day at 12am

I have a few OMV systems running but one has this issue. I am trying to track it down as i think it is occasionally bringing down a docker container (hypothesis only)...

So this server has high cpu/load every day at midnight since 28 November - before that everything is normal.

Every day since I see the following in my log. There is nothing much else to help me troubleshoot. I thought it was related to a docker container but I now think that is unrelated as I have resolved the issue with the container and setup the same container/config on 2x test OMV servers and I do not see the same behaviour.

All I have to go on is that it started on 28 November.

Nov 28 00:00:54 rpi5 monit[1214]: 'rpi5' loadavg (5min) of 4.3 matches resource limit [loadavg (5min) > 4.0]
Nov 28 00:00:54 rpi5 monit[1214]: 'rpi5' loadavg (1min) of 13.9 matches resource limit [loadavg (1min) > 8.0]
Nov 28 00:01:24 rpi5 monit[1214]: 'rpi5' loadavg (1min) of 8.4 matches resource limit [loadavg (1min) > 8.0]
Nov 28 00:01:54 rpi5 monit[1214]: 'rpi5' loadavg (5min) check succeeded [current loadavg (5min) = 3.5]
Nov 28 00:01:54 rpi5 monit[1214]: 'rpi5' loadavg (1min) check succeeded [current loadavg (1min) = 5.1]
Nov 29 00:01:22 rpi5 monit[1214]: 'rpi5' loadavg (1min) of 8.9 matches resource limit [loadavg (1min) > 8.0]
Nov 29 00:01:52 rpi5 monit[1214]: 'rpi5' loadavg (1min) check succeeded [current loadavg (1min) = 5.4]

good suggestion - I will have to stay up to watch that. exciting. haha

Thanks.

Quite tricky to find what in HA was causing it but I have finally found the issue after a few days of elimination.

Sorry. Very obscure issue with a 3rd party integration. So didn’t think anyone would be interested. 😂

It turned out to be this integration for Apple device tracking (icloud3) runs Maintainance at midnight on a database that holds location data. There was a corruption in the database.