31 releases
Uses new Rust 2024
| 0.6.16 | Oct 30, 2025 |
|---|---|
| 0.6.12 | Jul 24, 2025 |
| 0.5.11 | Mar 27, 2025 |
| 0.5.10 | Nov 22, 2024 |
| 0.4.1 | Dec 20, 2023 |
#1448 in Text processing
535KB
11K
SLoC
Custom text tokenizer
Dependencies
~1MB
~18K SLoC
Uses new Rust 2024
| 0.6.16 | Oct 30, 2025 |
|---|---|
| 0.6.12 | Jul 24, 2025 |
| 0.5.11 | Mar 27, 2025 |
| 0.5.10 | Nov 22, 2024 |
| 0.4.1 | Dec 20, 2023 |
#1448 in Text processing
535KB
11K
SLoC
Custom text tokenizer
~1MB
~18K SLoC