]> Savannah Git Hosting - gnulib.git/commit
libunistring: update to Unicode 9.0.0 ueno/unicode-9.0.0
authorDaiki Ueno <ueno@gnu.org>
Wed, 12 Oct 2016 15:40:37 +0000 (17:40 +0200)
committerDaiki Ueno <dueno@redhat.com>
Mon, 30 Oct 2017 10:13:20 +0000 (11:13 +0100)
commited0bf5d5284b787af71b1b95fca1fdb6389fee3c
tree2825a6954b97ec150986e07b8b2ae32c45ea52b0
parentf466816e06ec3516567c3edcd0219bd1f9b736eb
libunistring: update to Unicode 9.0.0

* lib/gen-uni-tables.c (fill_properties): Recognize Sentence_Terminal
and Prepended_Concatenation_Mark.
(is_property_default_ignorable_code_point): Exclude U+08E2.
(fill_arabicshaping): Allow missing whitespace when parsing;
recognize "AFRICAN FEH", "AFRICAN QAF", and "AFRICAN MOON".
(output_blocks): Increase the element size of the level1 table to
accommodate more blocks.
(get_lbp): Recognize ZWJ, E_Base, and E_Modifier characters;
Update each class according to the standard.
(get_wbp): Recognize ZWJ, E_Base, E_Modifier, Glue_After_Zwj, and
E_Base_GAZ characters.
(output_gbp_table): Recognize ZWJ, E_Base, E_Modifier, Glue_After_Zwj,
and E_Base_GAZ characters.
* lib/unictype.in.h (UC_JOINING_GROUP_AFRICAN_FEH,
UC_JOINING_GROUP_AFRICAN_QAF, UC_JOINING_GROUP_AFRICAN_MOON): New enum value.
* lib/unilbrk/lbrktables.h (LBP_ZWJ, LBP_EB, LBP_EM): New enum value.
* lib/unilbrk/lbrktables.c (unilbrk_table): Extend the table with
LBP_ZWJ, LBP_EB, and LBP_EM.
* lib/uniwbrk.in.h (WBP_ZWJ, WBP_EB, WBP_EM, WBP_GAZ, WBP_EBG): New
enum value.
* lib/uniwbrk/u-wordbreaks.h: Implement WB3c, WB15, and WB16.
* lib/uniwbrk/wbrktable.h (uniwbrk_prop_index): New variable declaration.
* lib/uniwbrk/wbrktable.c (uniwbrk_prop_index): New variable.
(uniwbrk_table): Implement WB14.
* tests/uniwbrk/test-uc-wordbreaks.c (wordbreakproperty_to_string):
Check WBP_ZWJ, WBP_EB, WBP_EM, WBP_GAZ, and WBP_EBG.
* modules/unigbrk/u{32,16,8}-grapheme-breaks: No longer depend on
uc-is-grapheme-break.
* modules/unigbrk/uc-grapheme-breaks: New module.
* modules/unigbrk/uc-grapheme-breaks-tests: New module.
* lib/unigbrk.in.h (GBP_ZWJ, GBP_EB, GBP_EM, GBP_GAZ, GBP_EBG): New
enum value.
(uc_grapheme_breaks): New function, replacing uc_is_grapheme_break.
* lib/unigbrk/u-grapheme-breaks.h: New file.
* lib/unigbrk/u{32,16,8}-grapheme-breaks.c: Rewrite using
u-grapheme-breaks.h instead of uc_is_grapheme_break.
* lib/unigbrk/uc-grapheme-breaks.c: New file.
* lib/unigbrk/uc-is-grapheme-break.c: Partially update to TR29 rev 29.
* tests/unigbrk/test-uc-gbrk-prop.c (graphemebreakproperty_to_string):
Check GBP_ZWJ, GBP_EB, GBP_EM, GBP_GAZ, and GBP_EBG.
* tests/unigbrk/test-uc-grapheme-breaks.c: New test.
* tests/unigbrk/test-uc-is-grapheme-break.c (graphemebreakproperty_to_string):
Check GBP_ZWJ, GBP_EB, GBP_EM, GBP_GAZ, and GBP_EBG.
(main): Skip unsupported rules involving 3 or more characters, namely
GB10, GB12, and GB13.
* lib/uniwidth/width.c (nonspacing_table_data): Update.
29 files changed:
lib/gen-uni-tables.c
lib/unictype.in.h
lib/unigbrk.in.h
lib/unigbrk/u-grapheme-breaks.h [new file with mode: 0644]
lib/unigbrk/u16-grapheme-breaks.c
lib/unigbrk/u32-grapheme-breaks.c
lib/unigbrk/u8-grapheme-breaks.c
lib/unigbrk/uc-gbrk-prop.c
lib/unigbrk/uc-grapheme-breaks.c [new file with mode: 0644]
lib/unigbrk/uc-is-grapheme-break.c
lib/unilbrk/lbrktables.c
lib/unilbrk/lbrktables.h
lib/uniname/gen-uninames.lisp
lib/uniwbrk.in.h
lib/uniwbrk/u-wordbreaks.h
lib/uniwbrk/wbrktable.c
lib/uniwbrk/wbrktable.h
lib/uniwidth/width.c
modules/unigbrk/u16-grapheme-breaks
modules/unigbrk/u32-grapheme-breaks
modules/unigbrk/u8-grapheme-breaks
modules/unigbrk/uc-grapheme-breaks [new file with mode: 0644]
modules/unigbrk/uc-grapheme-breaks-tests [new file with mode: 0644]
tests/unigbrk/test-uc-gbrk-prop.c
tests/unigbrk/test-uc-grapheme-breaks.c [new file with mode: 0644]
tests/unigbrk/test-uc-grapheme-breaks.sh [new file with mode: 0755]
tests/unigbrk/test-uc-is-grapheme-break.c
tests/uniwbrk/test-uc-wordbreaks.c
tests/uniwidth/test-uc_width2.sh