In order to avoid this problem, first thing you can try, is to increase PHP's memory limit.
By default, PHP's memory limit is set to a value less than, or equal to 128M, which is not always enough for resource intensive tasks, so increasing the memory limit to 256M or more, can help.
You can check this article and this one, while they don't specifically talk about increasing the memory limit for PHP, they give enough info for you to understand how to do it.
Remember to restart your web server and/or PHP-FPM after you apply the changes to your PHP configuration.
If removing those columns is not an option, then AppMail provides a console command to help you warmup the cache for the stats shown in those column. You can find more details about the command here.
We recommend adding this command in your cron jobs list and run it each minute, so it keeps your cache warmed up all the time.