[Catalyst] tips for troubleshooting/QAing Unicode (was Re: Passing UTF-8 arg in URL to DBIC search)

[Lee Aylward]

On Sun, Sep 28, 2008 at 08:41:09PM -0500, Lee Aylward wrote:
> 
> Great timing on this as I am currently struggling with some unicode text
> not displaying correctly in an application I am working on. Per your
> suggestion I put the Japanese text at the top of my template. All of a
> sudden the browsers started displaying that and other non-ascii characters
> correctly. The second I take away the Japanese text it goes back to just
> showing question marks. I am seeing this behavior in both the test
> server and Apache.
> 
> I have looked at the Content-Type header and it is definitely serving it
> as utf-8, so I am at abit of a loss. There are no databases involved
> here, but I am displaying information from IMDB::Film. Is there anything
> in the actual HTML that needs to be set?
> 

A little more info. I checked my page on the w3 validator and it
returned this:

 Sorry, I am unable to validate this document because on line 245  it
 contained one or more bytes that I cannot interpret as utf-8  (in other
 words, the bytes found are not valid values in the specified Character
 Encoding). Please check both the content of the file and the character
 encoding indication.

 The error was: utf8 "\xE9" does not map to Unicode 

 http://validator.w3.org/check?uri=http%3A%2F%2Fprettybrd.com%2Ffilm%2Fperson%2F0001951&charset=%28detect+automatically%29&doctype=Inline&group=0

Perhaps my strings are getting encoded twice? I'll add the suggestion of
trying the validator to the wiki page, but it would be nice to have a
solution to this specific problem on there as well.

-- 
Lee Aylward
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 197 bytes
Desc: Digital signature
Url : http://lists.scsys.co.uk/pipermail/catalyst/attachments/20080928/9fa97394/attachment.pgp