Skip to content

JParseCode 0.21.0

Compare
Choose a tag to compare
@TeamworkGuy2 TeamworkGuy2 released this 26 Nov 17:27
· 4 commits to master since this release

Parsing performance optimizations (~15-20%)

Changed

  • Update dependencies jtext-tokenizer@0.7.0 and jtext-parser@0.18.0
  • ParserActionLogger and ParseTimes optimizations and changes to work with jtext-tokenizer new TokenizationLogger
  • JavaFileTokenizer, CsFileTokenizer, CommentTokenizer, IdentifierTokenizer, and NumberTokenizer reusable/reusableCharParsers flag implementation to control which CharParserMatchableFactory implementation is used
  • CodeTokenizer.tokenizeDocument() fragmentConstructor parameter optimization to skip creating fragment source string twice, major performance improvement ~5-10%
  • New aggregate performance logging output for text tokenization related counters