Gitiles
Code Review Sign In
gerrit-public.fairphone.software / platform / external / rust / crates / unicode-segmentation / 8338d495f55dd382e52b4f533477c123c6f19409
commit8338d495f55dd382e52b4f533477c123c6f19409[log] [tgz]
authorThiébaud Weksteen <tweek@google.com>Tue Jan 12 15:26:32 2021 +0100
committerThiébaud Weksteen <tweek@google.com>Tue Jan 12 16:05:08 2021 +0100
tree105b11804aeb0f9145691efc85a60b309f00f7bf
parent36fe69891d2f6c6bbf6d6bd09220076ff7d8cfe8 [diff]
Add std patch

Test: run external_updater and verify that the patch is applied
Change-Id: Ia3f6420936423dda6f092e99e7e3d3bfafffac2e
1 file changed
tree: 105b11804aeb0f9145691efc85a60b309f00f7bf
  1. patches/
  2. scripts/
  3. src/
  4. LICENSE ⇨ LICENSE-APACHE
  5. NOTICE ⇨ LICENSE
  6. .cargo_vcs_info.json
  7. .gitignore
  8. .travis.yml
  9. Android.bp
  10. Cargo.toml
  11. Cargo.toml.orig
  12. COPYRIGHT
  13. LICENSE-APACHE
  14. LICENSE-MIT
  15. METADATA
  16. MODULE_LICENSE_APACHE2
  17. OWNERS
  18. README.md
  19. TEST_MAPPING
README.md

Iterators which split strings on Grapheme Cluster or Word boundaries, according to the Unicode Standard Annex #29 rules.

Build Status

Documentation

use unicode_segmentation::UnicodeSegmentation;

fn main() {
    let s = "a̐éö̲\r\n";
    let g = UnicodeSegmentation::graphemes(s, true).collect::<Vec<&str>>();
    let b: &[_] = &["a̐", "é", "ö̲", "\r\n"];
    assert_eq!(g, b);

    let s = "The quick (\"brown\") fox can't jump 32.3 feet, right?";
    let w = s.unicode_words().collect::<Vec<&str>>();
    let b: &[_] = &["The", "quick", "brown", "fox", "can't", "jump", "32.3", "feet", "right"];
    assert_eq!(w, b);

    let s = "The quick (\"brown\")  fox";
    let w = s.split_word_bounds().collect::<Vec<&str>>();
    let b: &[_] = &["The", " ", "quick", " ", "(", "\"", "brown", "\"", ")", " ", " ", "fox"];
    assert_eq!(w, b);
}

no_std

unicode-segmentation does not depend on libstd, so it can be used in crates with the #![no_std] attribute.

crates.io

You can use this package in your project by adding the following to your Cargo.toml:

[dependencies]
unicode-segmentation = "1.3.0"

Change Log

1.6.0

  • #72 Upgrade to Unicode 12

1.5.0

  • #68 Upgrade to Unicode 11

1.4.0

  • #56 Upgrade to Unicode 10

1.3.0

  • #24 Add support for sentence boundaries
  • #44 Treat gc=No as a subset of gc=N

1.2.1

  • #37: Fix panic in provide_context.
  • #40: Fix crash in prev_boundary.

1.2.0

  • New GraphemeCursor API allows random access and bidirectional iteration.
  • Fixed incorrect splitting of certain emoji modifier sequences.

1.1.0

  • Add as_str methods to the iterator types.

1.0.3

  • Code cleanup and additional tests.

1.0.1

  • Fix a bug affecting some grapheme clusters containing Prepend characters.

1.0.0

  • Upgrade to Unicode 9.0.0.