Does it happen when using some client or when not doing anything it also happens?
It happens more when using Amethyst, or when relay aggregation was ON. I turned relay aggregation OFF now so it happens less frequently now.