[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Registration of new charset BOCU-1 refreshed
- To: charsets <ietf-charsets@iana.org>
- Subject: Registration of new charset BOCU-1 refreshed
- From: Markus Scherer <markus.scherer@jtcsv.com>
- Date: Thu, 22 Aug 2002 17:29:06 -0700
- Organization: IBM
- Original-recipient: rfc822;ned+ietf-charsets@mrochek.com
- Spam-test: False ; 1.1 / 5.2
- User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:0.9.4)Gecko/20011019 Netscape6/6.2
I would like to refresh the BOCU-1 registration text to the current state of the discussion.
Changes compared to the original proposal from July 10:
- changed the confusing paragraph about CCS & CES as agreed
- changed the specification URL to UTN #6
I hope that the consolidated text helps with the registration process.
Please let me know if there is anything else that I can do.
Sincerely,
markus
---- 8< ----
Charset name: BOCU-1
Charset aliases: (none, except for the implicit csBOCU-1)
Suitability for use in MIME text: Yes
Published specifications:
Specification of BOCU-1 with sample code for conversion to/from Unicode:
http://www.unicode.org/notes/tn6/
Description of the general "BOCU" algorithm,
with a link to the BOCU-1 specification:
http://oss.software.ibm.com/icu/docs/papers/binary_ordered_compression_for_unicode.html
A converter implementation that is conformant to this specification is
available in ICU (http://oss.software.ibm.com/icu/), an open-source library.
The BOCU-1 converter C source code is in icu/source/common/ucnvbocu.c:
http://oss.software.ibm.com/cvs/icu/~checkout~/icu/source/common/ucnvbocu.c
CCS & CES: The BOCU-1 charset is a combination of the
Unicode/ISO 10646 Coded Character Set (CCS) with
the Character Encoding Scheme (CES) specified in
the above document. It covers exactly the
UTF-16-reachable subset of ISO 10646.
ISO 10646 equivalency table:
Algorithmic, see published specification and sample code.
Additional information:
BOCU-1 is an encoding (CES/TES) of Unicode/ISO 10646
for the storage and exchange of text data.
It is stateful and provides a good byte/code point ratio while
being directly usable in SMTP emails, database fields and other contexts.
BOCU-1 combines the wide applicability of UTF-8 with the compactness of SCSU.
It is useful for short strings and maintains code point order.
BOCU-1 does not encode most ASCII characters with US-ASCII byte values.
There is a Unicode signature byte sequence defined
(FB EE 28, see specification).
BOCU-1 is suitable for
- databases: maintains Unicode code point order
- emails: directly suitable for MIME text
- CVS and similar: deterministic and resets at CR and LF
BOCU-1 is not suitable for
- efficient internal processing (convert to UTF-8/16/32)
- contexts where encoding declarations _in_ documents _must_ be ASCII-readable
Person & email address to contact for further information:
Markus W. Scherer
IBM Globalization Center of Competency
5600 Cottle Road
Mail Stop: 50-2/B11
San Jose, CA 95193
USA
markus.scherer@jtcsv.com
markus.scherer@us.ibm.com
Intended usage: LIMITED USE
----
Suggested MIBenum value: 1020
(first available in Unicode/ISO 10646 range; like SCSU [which is 1011])
Thank you for your consideration,
markus