We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent c1fa0a8 commit 3ebc831Copy full SHA for 3ebc831
stanza/models/tokenization/utils.py
@@ -18,7 +18,7 @@
18
logger = logging.getLogger('stanza')
19
paths = default_paths.get_default_paths()
20
21
-def create_dictionary(lexicon=None):
+def create_dictionary(lexicon):
22
"""
23
This function is to create a new dictionary used for improving tokenization model for multi-syllable words languages
24
such as vi, zh or th. This function takes the lexicon as input and output a dictionary that contains three set:
0 commit comments