NVIP v1.2.2

• Generic Parser for parsing sources that the crawler is unfamiliar with.
• Includes a set of 'strategies' for parsing new sources based on the following HTML layout patterns
  • Table
  • List
  • Accordion
  • Bulletin
  • Default
• Updated NVD comparison process by utilizing NVDs 2.0 API
• Fixed an issue where all CVEs were only coming from one source
• Fixed an issue where exploit finder took more than 3 hours to complete.
• Exploit Finder now scrapes exploits from ExploitDBs Gitlab repo.
• An additional 100 seed URLs added to the crawler seeds. NVIP now uses over 500 sources
• Email Service is now working

NVIP v1.2.1

Contains the following:

• Seed URL list file and Whitelist with 100+ URLs for the crawler to navigate to
• Updated Email Service code, some issues still remain
• Updated cache population process for adding CVEs to the UI
• Adjusted (but not perfect) logic for time gaps and CVEs not in NVD
• Some additional Parsers

More on this release below:

What's Changed

• added characterization data dependencies by @memeeerit in #1
• Nvip rebase by @aep7128 in #3
• Defaults setup by @aep7128 in #4
• Aggregate prepared stmt by @aep7128 in #6
• Commented out unecessary logger statements by @atsawtelle in #5
• Graph fixes 2 by @aep7128 in #10
• Parser fixes 146 by @cju8676 in #7
• Dev by @aep7128 in #11

New Contributors

• @memeeerit made their first contribution in #1
• @aep7128 made their first contribution in #3
• @atsawtelle made their first contribution in #5
• @cju8676 made their first contribution in #7

Full Changelog: https://github.com/SoftwareDesignLab/nvip-crawler/commits/v1.2.1