[Dbix-class] inserting utf8 data into varchar columns for a postgres utf8 database

[Adam Paynter]

Howdy,

We have run into many nightmares at our organization with regards to this.
We also use PostgreSQL 8. Although there are other ways of solving the
problem, I typically do something as follows:

use Encode qw( _utf8_off _utf8_on from_to );

fix {
    my $s     return undef unless defined $s;
    _utf8_off( $s );
    from_to( $s, 'cp1250', 'utf8' );
    _utf8_on( $s );
    return $s;
}

my $nice_string 
Perhaps this will help!

- Adam

On 10/4/06, John Napiorkowski <jjn1056 at yahoo.com> wrote:
>
> Okay,
>
> Sorry this had nothing to do with utf8, but some data
> that was formated in CHARSET=windows-1252, that crazy
> windows only format.
>
> I found a modules called, "Encode::ZapCP1252" but that
> didn't seem to help me.  It actually seemed to just
> delete all the values it received without changing
> anything.
>
> I could run a regex to clean this out but that's
> really ugly.
>
> Has anyone run into that and found a more elegant
> solution (besides yelling at the people sending me
> windows only data?)?
>
> Thanks!
>
> John Napiorkowski
>
> --- John Napiorkowski <jjn1056 at yahoo.com> wrote:
>
> > Hi,
> >
> > I'm having trouble inserting data that has some utf8
> > characters mixed in.  I am using a postgres 8.1x
> > database and the database was created with utf8
> > option.
> >
> > The error I get is:
> >
> > INSERT INTO ... execute failed: ERROR invalid byte
> > sequence for encoding "UTF8".
> >
> > The value it's failing on is "Bjørn Stabell".
> >
> > I looked at the DBIx::Class::UTF8Columns component
> > but
> > I wasn't sure how that could help me or if it could
> > help me.
> >
> > I'm running this under Catalyst and thought I was
> > doing utf8 correctly, based on the (unfortunately
> > few)
> > examples I could find.
> >
> > I'm sure this is something simple I should do but
> > google is not being kind to my inquiries.  How have
> > the rest of you been dealing with this?
> >
> > Thanks!
> > John Napiorkowski
> >
> > __________________________________________________
> > Do You Yahoo!?
> > Tired of spam?  Yahoo! Mail has the best spam
> > protection around
> > http://mail.yahoo.com
> >
> > _______________________________________________
> > List:
> >
> http://lists.rawmode.org/cgi-bin/mailman/listinfo/dbix-class
> > Wiki: http://dbix-class.shadowcatsystems.co.uk/
> > IRC: irc.perl.org#dbix-class
> > SVN:
> >
> http://dev.catalyst.perl.org/repos/bast/trunk/DBIx-Class/
> > Searchable Archive:
> >
> http://www.mail-archive.com/dbix-class@lists.rawmode.org/
> >
>
>
> __________________________________________________
> Do You Yahoo!?
> Tired of spam?  Yahoo! Mail has the best spam protection around
> http://mail.yahoo.com
>
> _______________________________________________
> List: http://lists.rawmode.org/cgi-bin/mailman/listinfo/dbix-class
> Wiki: http://dbix-class.shadowcatsystems.co.uk/
> IRC: irc.perl.org#dbix-class
> SVN: http://dev.catalyst.perl.org/repos/bast/trunk/DBIx-Class/
> Searchable Archive:
> http://www.mail-archive.com/dbix-class@lists.rawmode.org/
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.rawmode.org/pipermail/dbix-class/attachments/20061005/310bc68e/attachment.htm