Spark Demo with Jupyter Notebook
Download the "Wikitext-2 word level" data from here: Website, ZIP
Create the environment with Anaconda from the environment.yml
file.
conda env create -f environment.yml
Open Jupyter with
jupyter notebook
and open the "Text data preprocessing" notebook.