CharacterTextSplitter中的参数问题 #26936
Closed
wy371900521
started this conversation in
General
Replies: 1 comment
-
Generally going to request that questions are phrased in English. You can use chat gpt to translate to English if you want to ask a question |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
text_spliter = CharacterTextSplitter(
separator=',',
chunk_size=10,
chunk_overlap=2
)
result = text_spliter.split_text("今天天气好晴朗,处处好风光啊好风光蝴蝶儿忙啊,蜜蜂也忙,小鸟儿忙着,白云也忙")
print(result) # 运行结果 => ['今天天气好晴朗', ',处处好风光啊好风光蝴蝶儿忙啊', ',蜜蜂也忙', ',小鸟儿忙着', ',白云也忙']
其中 chunk_overlap 并没有起到作用
Beta Was this translation helpful? Give feedback.
All reactions