Access Management | login.microsoftonline.com refused to connect | Unexpectedly closed the Connection

Question

We are using Access Management with SDL Tridion 9.6. Most of the Times we are facing loggin.microsoftonline.com refused to Connect or "xxx.com Unexpectedly closed the Connection" Errors.

we are set the http headers as below(file path: /SDL/Tridion Sites/web/web.config)

 <httpProtocol>
      <customHeaders>
        <remove name="X-Powered-By" />
        <remove name="X-Frame-Options" />
                <add name="X-Frame-Options" value="AllowAll" />
                <add name="Access-Control-Allow-Origin" value="https://cmsurl.com" />
      </customHeaders>
    </httpProtocol>

We are set the value "AutomaticRedirectAfterSignOut": true on Access management settings but login popup is not appearing after cache lifetime.

What are the values we can set, atleast the application can run around 10 hours with out token expire (we are using timeout values as below)? how Max time we can use with Access management (SAML Identifier)?.Can you Please help us how to fix the Issue.

"ClientSettings": {
    "AccessTokenLifetime": 18000,
    "CacheLifetime": 150,
    "ShowPII": true
  }
"AccountOptions": {
    "ShowLogoutPrompt": true,
    "AutomaticRedirectAfterSignOut": true,
    "IncludeWindowsGroups": false
  },
  "ForwardedHeadersOptions": {
    "ForwardedHeaders": "All",
    "KnownProxies": [],
    "KnownNetworks": []
  }