Comments on: Ruby, part2

By: Sergey Udaltsov

Sergey Udaltsov — Sat, 29 Sep 2007 13:50:33 +0000

jose,

Thanks for the snippet and the links! Very useful!

By: jose akallo

jose akallo — Sat, 29 Sep 2007 13:14:41 +0000

There is a u16tou8 method in rbuconv, http://www.yoshidam.net/Ruby.html that goes like this:

def u16tou8(str) ret = combineSurrogatePair(str.unpack('v*')).pack('U*') ret.taint if str.tainted? ret end

Would this do what you want?

Some useful utf8 methods btw can be found at http://snippets.dzone.com/posts/show/4527

Cheers,
jose

By: Sergey Udaltsov

Sergey Udaltsov — Sat, 22 Sep 2007 22:22:24 +0000

Rutger, I mean String.unpack function (modeled after the perl’s one AFAIK). It has syntax for UTF-8 but not for UTF-16. I know about iconv (and uconv) but that’s not exactly same thing…

By: Rutger Nijlunsing

Rutger Nijlunsing — Sat, 22 Sep 2007 16:12:36 +0000

I don’t know what you mean by ‘unpacking’, but for UTF16 I tend to use

require ‘iconv’

class Iconv
def self.utf8_to_utf16(str); Iconv.iconv(“UTF-16LE”, “UTF-8″, str)[0]; end
def self.utf16_to_utf8(str); Iconv.iconv(“UTF-8″, “UTF-16LE”, str)[0]; end
end

…to convert between utf8 and utf16.

By: Felipe Contreras

Felipe Contreras — Sat, 22 Sep 2007 13:41:25 +0000

Fortunately the Ruby community is very friendly and would probably welcome your rant. I recommend the Ruby Talk mailing list.

http://www.ruby-lang.org/en/community/

What I could find is that Unicode strings are planned for Ruby 2.0 and:

http://rubyforge.org/projects/icu4r/
http://raa.ruby-lang.org/project/uconv/
http://www.geocities.jp/kosako3/oniguruma/