Arabic Content Not Retrieved from Broker correctly in Web 8

Question

I am trying to retrieve Arabic Content for my website. I am able to save the content in CMS and also able to publish it to Broker correctly. When I am trying to access it from my .NET DXA Application, some characters are getting replaced by '?'

I have done the below mappings: In Master Layout File:

<meta http-equiv="Content Type" content="text/html; charset=UTF-8" />

In Application Web.Config:

<globalization resourceProviderFactoryType="Sdl.Web.Mvc.Configuration.ResourceProviderFactory, Sdl.Web.Mvc" fileEncoding="UTF-8" requestEncoding="UTF-8" responseEncoding="UTF-8"/>

In Deployer and Discovery Services cd_storage_conf.xml file:

<Role Name="DeployerCapability" Url="http://localhost:8084/httpupload">
     <Property Name="undo.enabled" Value="false"/>
     <Property Name="encoding" Value="UTF-8"/>
</Role> 

I restarted the Deployer Service, Registered the Discovery Service, and restarted it again.

I am not sure if I am missing anything. Currently, I am using SDL Web 8.1 & DXA 1.5

To add further, please find the original Arabic Text, and the Response Arabic Text.

Original Arabic Text:

مبادرة بيرل تكرم (سابك) لقيادتها ومساهمتها البارزة في تعزيز ممارسات الحوكمة والاستدامة في منطقة الخليج

Response Arabic Text:

مبادرة بيرل تكرم (سابك) لقيادتها ومساهمتها البارزة �?ي تعزيز ممارسات الحوكمة والاستدامة �?ي منطقة الخليج

This issue is coming for the Components Published with Dynamic Component Templates. For Component Presentations Embedded on the Page, the Arabic text is coming absolutely fine now.

Please help.

Answer 1

Please try adding the following file.encoding Java System Property to the installation script. For example, for installService.ps1:

$jvmoptions = "-Xrs", "-Xms256m", "-Xmx256m", "-Dfile.encoding=UTF-8"

There's currently an issue in that the Deployer ignores the encoding property set within the Role configuration.

You will also need to reinstall the service on Windows platforms after making this change.