Skip to content
This repository was archived by the owner on Mar 1, 2022. It is now read-only.
This repository was archived by the owner on Mar 1, 2022. It is now read-only.

新词发现 #63

@Nickname1230

Description

@Nickname1230

SmoothNLP-master/smoothnlp/algorithm/phrase/ngram_utils.py", line 75, in _process_corpus_chunk
ngram_keys[ni] = (ngram_keys[ni] | nigram_freq.keys())
MemoryError
问题是ngram_keys过大?有什么优化方法吗

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions