Supporting overlapping chunks #28
Description
The current chunks are non-overlapping, that is, the text is split into chunks such as they can be concatenated back and assemble the original text. That means if information to answer the question appears in the document in a chunk-size segment that is split into two separate chunks, the system will fail to answer the question.
Better performance can be obtained by duplicating the document and using overlapping chunks.
This functionality ought to be available through a configuration option (#5).