Releases: OpenPecha/Botok
Releases · OpenPecha/Botok
v0.9.0
v0.8.15
v0.8.14
v0.8.14 (2025-03-09)
Bug Fixes
- Improve test coverage to 90% and fix Python 3.12 compatibility (
8170f40
)
Detailed Changes: v0.8.13...v0.8.14
v0.8.13
v0.8.13 (2025-01-24)
Bug Fixes
-
Sentence normalizer test case updated (
9d0af85
) -
Versin bump from 8.12 to 8.13 (
249b667
) -
normalization: Fix for short strings (
85a3155
)
Detailed Changes: v0.8.12...v0.8.13
v0.8.12
v0.8.11
v0.8.10
Fix
- sent-tokenizer: Normalised sentence is included in sentence tokens (
7cf455d
) - NO_POS typos (
5d521a8
) - Auto release (
65b0931
) - Auto release (
159d39e
) - Auto release (
c961147
) - Auto release (
1d56341
) - Auto release (
b48e017
) - Auto release (
ab9cf0a
) - trie: Non inflectible word type error bug fix (
36ad9ca
) - tokenize: Another case of unexpected skip of syl (
deacd59
) - tokenize: Syl of remove word getting skipped unexpectly (
161445e
) - split_affixztion: Keyerror bug fix by using pop method to delete items (
a981693
) - adjusttoken: Rules having invalid index are not considered and error msg is shown in that case (
bfe6218
) - WordTokenizer: Adjusted token list assigned to token list returned by tokenize method (
dc898a9
) - Set config kwargs to None (
04eaa9f
) - Select on .tsv files in dialect pack (
e24369a
) - Set part_lemmas attr to WordTokenizer (
56734a1
) - Running test under coverage (
69b2334
) - Use fully directory base config (
b292077
) - Use full directory base config (
38107fe
) - Skip rules when populating trie (
a16ef54
)