Could you release the code for preprocessing CHILDES data? #4
Description
Would you mind releasing the code for preprocessing CHILDES data? I find many extremely short lines like **CHI**: <UNK> <|endoftext|>. I also wonder how you get the <UNK>s in the text.
These would be very helpful for better data. Thanks!