6

I have the following:

  • SDL Web 8.5 AWS cloud setup
  • 1 deployer endpoint, dedicated instance
  • 2 deployer workers, dedicated instances
  • JMS notifications between deployers (Amazon SQS)
  • Redis BinaryStore (Amazon ElastiCache)
  • 2 Publishers, dedicated instances

The issue: While doing a publishing load test, the deployer workers stop momentarily processing the transport packages, then they resume. In the end everything is published and deployed correctly. However, why the pause?

There are roughly 5k items that are being published. The Publishers fill up the queue. The Deployer endpoint pushes all the transport packages into the Redis BinaryStore and send JMS notifications. The Deployer workers receive notifications and proceed to deploy the transport packages.

Roughly 12 minutes into the process (consistently after many test runs), the workers pause for about 7 minutes, then they resume successfully. There are no errors in the logs. All transport packages are successfully deployed. No errors anywhere. The Redis storage is far from being full. Why the pause?

During the pause the number of items "Waiting for Deployment" spikes to roughly 2k, but once the workers resume, they quickly deploy these packages successfully.

I tried with different parameters for number of workers, receive timeouts on JMS side, connectivity timeout on Redis adapter. No effect.

Has anybody seen this? Why is it happening? It's not really a bug, because functionally it eventually works, but performance is hindered, as the deploy job finishes quite some time after the rendering/transporting has been done by the Publishers.

  • It seems it has to do with DB server size. My CM and CD databases are on the same RDS instance. After increasing the instance type (doubling it), I see much shorter pause in the Deployer throughput. I believe it had to do with number of connections open on the DB server. – Mihai Cădariu Nov 12 '17 at 11:45
  • I don't see people lining up to come with a better answer Mihai. Why don't you put that as the answer and claim the kudos?! – Dominic Cronin Jul 8 at 17:41

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.