Can someone explain the CPU 5 minute load average thing to me?

So the 5min load average (and 1min and 15min) is a Linux specific thing and not directly to do with LogicMonitor. There are various pages online you can look at to understand it better, such as https://www.scoutapm.com/understanding-load-averages/. LogicMonitor themselves have a old page about it at https://www.logicmonitor.com/blog/what-the-heck-is-cpu-load-on-a-linux-machine-and-why-do-i-care.

The Linux load average represents the average number of processes either running on the CPU or waiting for resources (CPU or I/O). These averages are given as three numbers: 1-minute, 5-minute, and 15-minute averages.

A general rule of thumb is that your load average should not exceed the total number of CPU cores in your system. For example, if your server has 8 cores, a load average of 8 means all cores are fully utilized, and anything higher indicates tasks are queuing.

Short bursts above this limit, reflected in the 1-minute average, can be normal depending on workload. However, sustained overloads in the 5- or 15-minute averages may point to performance bottlenecks.

To find the number of CPU cores you can use:

cat /proc/cpuinfo | grep processor | wc -l

Or you can use something like top or htop.

Keep in mind that high load averages can also result from I/O bottlenecks, not just CPU saturation.

I would fire up `iotop` and see what processes are using lots of IO when the load average is high.