ruby-core

Issue #13220 has been updated by Radovan Smitala.


Shyouhei Urabe wrote:
> Radovan Smitala wrote:
> > It's not my blog post. But when i tried some testing cases they were really wrong and unexpected.
> 
> Can you, then, show us your testing cases so that we can look at the "wrong and unexpected" results?

This new information appears on blogpost:

> NOTE: After publication, some readers pointed out that many of the failures I mentioned wouldn't have happened if I would have normalized the unicode test strings. This is true. However strings aren't automatically normalized by Ruby or Rails (in any of the apps I tested). These tests were always meant to illustrate the worst-case and I think they're still useful in that regard. 

It looks like, author used some non-standard or normalized strings.

~~~ ruby
[1] pry(main)> "辰".ord
=> 97
[2] pry(main)> "辰".unicode_normalized?
=> false
[3] pry(main)> "辰".unicode_normalize.ord
=> 228
[4] pry(main)> "辰".ord
=> 228
[5] pry(main)> "辰".unicode_normalized?
=> true
~~~


Whole issue is just about that Ruby doesn't automatically normalize strings to Unicode.

----------------------------------------
Bug #13220: Enhance support of Unicode strings manipulation
https://bugs.ruby-lang.org/issues/13220#change-63018

* Author: Radovan Smitala
* Status: Feedback
* Priority: Normal
* Assignee: 
* Target version: 
* ruby -v: ruby 2.4.0p0 (2016-12-24 revision 57164) [x86_64-darwin16]
* Backport: 2.2: UNKNOWN, 2.3: UNKNOWN, 2.4: UNKNOWN
----------------------------------------
Hi,

last days, Starr Horne posted very interesting testing results about manipulation unicode strings in Ruby 2.4.
And many methods doesn't work as excepted.

Article:

http://blog.honeybadger.io/ruby-s-unicode-support/



-- 
https://bugs.ruby-lang.org/

Unsubscribe: <mailto:ruby-core-request@ruby-lang.org?subject=unsubscribe>
<http://lists.ruby-lang.org/cgi-bin/mailman/options/ruby-core>