-
-
Notifications
You must be signed in to change notification settings - Fork 22.2k
Open
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
I've created a document store and create 4 file loaders using always the same md file
I've used 4 different configuration of splitter type, and chunk size and overlap.
Following images shows the outcome of tests

Here seems to exist an issue (Markdown Text Splitter)

Testing using Recursive Character Text Splitter, shows the overlap - chunk size: 1000, overlap 400


To Reproduce
- Create a document store
- Create a document loader of text type
- Upload this md file jack_russell_guide_5pages.md
- Select chunk size: 1000, chunk overlap: 200
- Process
- Wait till document store status will be sync
- Access the view chunks option for the document loader just created.
No overlap seems to exists between chunks
Expected behavior
Overlaps are present, like happens when using Recursive Character Text Splitter
Screenshots
No response
Flow
No response
Use Method
None
Flowise Version
No response
Operating System
None
Browser
None
Additional context
No response
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working