Tokenizer release 3.1.0 (July 16, 2015)

amir-zeldes released this 16 Jul 19:09

· 31 commits to master since this release

b687320

New version of the tokenizer:

Corrects a bug with the line break addition parameter -l
Adds better support for constructions with je- and nominalized tre-f

Assets 2