We moved our websites to production environment and have been observing random slow response from random pages on all websites. Whenever we test it’s a different page that is slow to respond. It does happen randomly but mostly happens with dynamic pages.
Configuration:
2 load balanced web servers with 14gb RAM
DXA version 2.0.1
2 load balanced servers with 64GB RAM for microservices
72hrs caching on model service and 8GB memory for object caching. 6GB for content service caching
Output caching enabled on web application for 30min
We have not been able to replicate the issue in any other environment. We even tried pointing our local environment to production microservices and were unable to replicate the issue.
One difference between staging/production is the output-caching duration which is 30min for production (we assumed better performance with that) but its 2min in staging.
As per our infra team, there have not been any high memory or cpu usage. Our db has sp_updatestats enabled and as I mentioned, if we point our local environment to production db, then the issue doesnt occur. All dynamic pages load within 4 sec
Our thought is with the web servers only and may be, because there is more traffic on it than staging, may be IIS is unable to handle with 30min caching. But we are not sure how to confirm our suspicions or what else can it be.
Any suggestions that might help us would be greatly appreciated!