Bug: Jieba eats all memory with empty tables

[donhardman]

Bug Description:

When we have Jieba enabled on 100 tables, we have an issue where Manticore consumes 20 GB of memory, increasing with each new table added.

MRE:

Create 100 tables of the following structure:

CREATE TABLE webpage_sentence_example (
  id bigint
) charset_table='chinese' morphology='jieba_chinese'

Results:

MEM USAGE / LIMIT     MEM %
19.67GiB / 62.37GiB   31.53%

Manticore Search Version:

Latest

Operating System Version:

Ubuntu

Have you tried the latest development version?

None

Internal Checklist:

^{To be completed by the assignee. Check off tasks that have been completed or are not applicable.}

• Implementation completed
• Tests developed
• Documentation updated
• Documentation reviewed