Project

General

Profile

Actions

Feature #11094

closed

Remove traces of 6-byte UTF-8

Added by duerst (Martin Dürst) about 7 years ago. Updated about 7 years ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Target version:
-
[ruby-core:68982]

Description

UTF-8 was originally defined with a codespace up to 31 bits, and therefore with up to 6 bytes per character. Since quite a few years ago, it has been reduced in all the relevant definitions (ISO, Unicode, IETF) to a codespace up to 0x10FFFF and a maximum of 4 bytes per character. Many places in the Ruby code base are updated to this 4 byte limit (e.g. EncLen_UTF8 in enc/utf_8.c). But other places in the Ruby code base are not yet updated to this limit (e.g. code_to_mbclen in enc/utf_8.c). This should be fixed.
[I have classified this as a feature because I wasn't able to find a way to expose this problem in Ruby code, but this should be reclassified as a bug if such a problem can be found.]


Files

0001-enc-utf_8.c-pack.c-limit-UTF-8.patch (6.68 KB) 0001-enc-utf_8.c-pack.c-limit-UTF-8.patch nobu (Nobuyoshi Nakada), 04/25/2015 04:42 AM

Related issues 3 (1 open2 closed)

Related to Ruby master - Bug #13353: Backport stringio fixesClosedActions
Related to Ruby master - Bug #13590: Change max byte length of UTF-8 to 4 bytes to conform to definition of UTF-8Closedduerst (Martin Dürst)Actions
Related to Ruby master - Feature #13588: Add Encoding#min_char_size, #max_char_size, #minmax_char_sizeFeedbackActions
Actions

Also available in: Atom PDF