Display on Page is not working for non-english locale Russian

Just tested additionaly - this problem also reproduced in 6.1.10 EE.
To reproduce problem - no needs to create web-content in specific language.
Issue in using language prefix in URL and using non-ascii symbols in web-content title.
If I'm navigating to:
http://localhost:8080/web/smartphones/-/%D1%8D%D1%82%D0%BE-%D0%BD%D0%BE%D0%B2%D0%BE%D1%81%D1%82%D1%8C-%D0%BD%D0%B0-%D1%80%D1%83%D1%81%D1%81%D0%BA%D0%BE%D0%BC
jourtal article found well and it is displayed on related page
If I'm trying to navigate to
http://localhost:8080/ru/web/smartphones/-/%D1%8D%D1%82%D0%BE-%D0%BD%D0%BE%D0%B2%D0%BE%D1%81%D1%82%D1%8C-%D0%BD%D0%B0-%D1%80%D1%83%D1%81%D1%81%D0%BA%D0%BE%D0%BC
journal article is not found and default site page is displayed.

It happens because in first (correct) case method PortalImpl.getJournalArticleActualURL received decoded friendlyURL, but in second case - not decoded - and as result cannot find specific journal article

In my cases for fixing this issue I've added followed class as service hook. But I'm not sure it is correct place to do decode - probably it should be done in I18NServlet

public class PortalImplExt extends PortalImpl {
public String getJournalArticleActualURL(
long groupId, String mainPath, String friendlyURL,
Map<String, String[]> params, Map<String, Object> requestContext)
throws PortalException, SystemException

private static Log _log = LogFactoryUtil.getLog(PortalImplExt.class);
}

Thanks Alexey for your contribution, I am creating a solution for Liferay 6.1.10 EE and 6.2.X based on your work.

Tamás, can you please perform the changes Sergio has advised and we discussed? Thanks!

Another problem related to this issue:
Lets create web-content with long (but acceptable) russian title: for example 150 symbols (acceptable length is 255).
If we will try to access this web-content by URL: http://hostname/-/quite-long-title-of-article-in-russian - it will be failed to find.
But if we will access it by http://hostname/web/guest/-/quite-long-title-of-article-in-russian - it will work.

Problem is in VirtualHostFilter class - in it's method isValidFriendlyURL
It called
int code = LayoutImpl.validateFriendlyURL(friendlyURL);

this mehtod also checks for length of url - and here is a problem.
Since russian symbols comes encoded (as %D0%BC%D0%BE%D1%81%D0%B3 ... ) - checked string is much longer then original title - so, it is not passed this check - and whole logic for processing this url goes incorrectly.

Here I see 2 solutions:
1. Friendly URL should be decoded somethere before (but I'm not sure there exactly - since it comes deep into Liferay internals)
2. We should ignore error LayoutFriendlyURLException.TOO_LONG in method VirtualHostFilter.isValidFriendlyURL

The main problem is the following:
In the Normalizer.java the normalizeToAscii method doesn't care about the Cyrillic characters. If we use Cyrillic-Latin transliterator there will be only two problematic characters : ' (UNICODE: 02B9) and " (UNICODE: 02BA). After that, we can use the StringUtil.replace method to change these characters(as it works correctly for the polish Ł character). This solution seems to work correctly, and solves both of the problems mention above.

Tables showing UNICODE characters in UTF-8 conversion: http://titus.uni-frankfurt.de/unicode/unitestx.htm

Fix is in https://github.com/brianchandotcom/liferay-portal/pull/4838 but won't pull in unless there is a unit test.

My posts with Long Cyrillic titles not opening. URL redirects to a previous page.
I implemented this fix in ext plugin. It not helped me.
Is this commit supposed to fix my bug?
Here is more information about my ext plugin http://stackoverflow.com/questions/10894849/liferay-ext-plugin-rewriting-java-class-in-util-java

I'm going to develop the test for this, because it's been stuck there for a while. I'm going to send the PR to you Brian after I'm done with it, so you can merge it together.

Thanks,

Máté

Brian, here goes the change again with the unit test added.

Committed on:
Portal 6.2.x GIT ID: 76bb75b643c53869801c61e69b882a38b0a83512.

PASSED Manual Testing following the steps in the description.

Reproduced on:
Tomcat 7.0 + MySQL 5. Portal 6.1.20 EE GA2.

Display page does not work for non-english locale on Asset Publisher.

Fixed on:
Tomcat 7.0 + MySQL 5. Portal 6.1.x EE GIT ID: 30ba0e21ec4cf4cfa456d152efec173ae6828801.
Tomcat 7.0 + MySQL 5. Portal 6.2.x GIT ID: 26db36dd1d8cb06b88163a37d3fd7dfecb175e4b.

Display page works for Russian locale on Asset Publisher.

Thank you Pani for testing. Closing as 'Fixed'.