Skip to content

Commit d6b2622

Browse files
author
jb-kerboeuf
authored
french tokenization
Hi Bruce ! I made some changes in the source code that affect only the tokenaztion when language=french I changed to things : particles before an apostrophe, and numeral adjectives like 1st and 3rd. Hope it helps a little.
1 parent d9ec4cf commit d6b2622

File tree

1 file changed

+2219
-2198
lines changed

1 file changed

+2219
-2198
lines changed

0 commit comments

Comments
 (0)