Crawler.net

Very simple web crawler using automatas Actually Mails and URLs are implemented (at least, parcially)

Usage

Clone the repository and use the dotnet CLI to run.

Example

git clone https://github.com/EdsonReza/Crawler.net.git
cd Crawler.net

dotnet run -- https://google.com/

The automatas implementation is in Classes/Automatas

Fix search in depth
support for the ability to recognize if the url does not belong to a resource like images, pdf, etc

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
.vscode		.vscode
Classes		Classes
Commands		Commands
docs		docs
.gitignore		.gitignore
Crawler.csproj		Crawler.csproj
LICENSE		LICENSE
Program.cs		Program.cs
README.md		README.md