[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Re: High CPU usage on some of the nodes due to message coalesce

I guess the code experts could shed more light on org.apache.cassandra.util.coalesceInternal and SepWorker.run.
I'll just add anything I can think of....

Any cron or other scheduler running on those nodes?
Lots of Java processes running simultaneously?
Heavy repair continuously running?
Lots of pending compactions?
Is the number of CPU cores the same in all the nodes?
Did you try rebooting one of the nodes?

On Sun, Oct 21, 2018 at 4:55 PM onmstester onmstester <onmstester@xxxxxxxx.invalid> wrote:

What takes the most CPU? System or User?

 most of it is used by org.apache.cassandra.util.coalesceInternal and SepWorker.run

Did you try removing a problematic node and installing a brand new one (instead of re-adding)?
I did not install a new node, but did remove the problematic node and CPU load in all the cluster became normal again

When you decommissioned these nodes, did the high CPU "move" to other nodes (probably data model/query issues) or was it completely gone? (server issues)
it was completely gone