This repository was archived by the owner on Feb 28, 2021. It is now read-only.
This repository was archived by the owner on Feb 28, 2021. It is now read-only.
Parallelize censoring #9
Description
I think dask is a good solution because it has a nice API and can be used in a cluster.
The easiest and most effective parallelization is to map words after tokenization.