Skip to content

FATEH02/VulScrapper

Repository files navigation

VulScrapper

VulScrapper is a Python-based web scraping tool that collects vulnerability data from web pages. It stores the extracted information in a database file and provides a user-friendly Streamlit web application for data visualization and reporting. It is integrated with an automatic alert system and an AI-powered feature for suggesting mitigation strategies automatically.

Deployment

To deploy this application locally, follow these steps:

Clone this repository

     git clone https://github.com/FATEH02/VulScrapper.git
     cd VulScrapper

Install requirements

    pip install -r requirements.txt

run god_scrapper.py

    python3 god_scrapper.py

This tool uses Selenium to scrape websites and BeautifulSoup for parsing the HTML content. The scraped data is stored in a CSV file using Python's csv module, and Pandas is used for managing and analyzing the dataset

run stream.py

    streamlit run stream.py

This script creates a web application using Streamlit

a csv database show that will show a list of all vulnarebilities colums like

ProductName Version OEM SeverityLevel Vulnerability MitigationStrategy PublishedDate UniqueID

Features Of Website

App Screenshot

Filters

App Screenshot

Detail of Vulnerability

App Screenshot

Email Send

a email will be send to user about severity and a attachment visulaized data App Screenshot

Email Received

Screenshot 1 Screenshot 2

Genrative Explaination

App Screenshot

visualize scraped data

App Screenshot

Algorithm

this a visulaized Algorithm for this problem App Screenshot

Features

  • Scrapes vulnerability data from the NVIDIA security page.

  • Stores data in a CSV format for easy access and manipulation.

  • Provides interactive filters for viewing vulnerabilities by severity and OEM.

  • Generates visualizations of vulnerability data, including pie charts and line graphs.

  • Sends email reports with generated PDF attachments.

  • Uses Google’s Generative AI to provide explanations for specific vulnerabilities.

API Reference

use Gemini Api in this code

AI Model Description
Gemini Gemini-1,5-flash Required. Your API key

Tech Stack

Python Streamlit Pandas Matplotlib Plotly Selenium Gmail Google Generative AI

About

A tool for data scraping and an alert system

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages