Quick Start
Refer to the Releases Page of github to download the latest version of EasySpider, based on your own operating system and platform (x64 or x86).
Here, we take the version on Windows 10 x64 version for example, for other operating systems, please click the corresponding page at the sider bar after you reading this guide:
Unzip the EasySpider_0.1.0_windows_amd64.7z file, then click the "EasySpider.exe" to run EasySpider, which shows the main UI of EasySpider:
[Notice] The software is totally not trojan/virus! If "EasySpider.exe" is mistaken by antivirus software such as windows defender as a virus, please recover it, or open "EasySpider.bat" to run EasySpider instead.
[Important] Set "Allow Access" in your Windows Defender Firewall, otherwise EasySpider will not able to access the Internet!
[Notice] EasySpider requires port 8084 for comminucation, which is very rarely to be occupied by other programs; in case it is in use by other program, try to find and close them before open EasySpider by the way posted here.
Click the "Design Task" button at the main UI to design the task. Wait for at most 10 seconds, then a web browser will automatically started and the task list will be shown:
Remember don't close the command line window, otherwise the browser will also be closed:
And also need to "Allow Access" in the firewall for Chrome, if encountered.
Click "New Task" Button to start design a new task, click "Modify Task" link in the task list to modify existing tasks:
Input the URL of the web page (must start with http:// or https://), and click the "Start Design" button:
Then the Web Browser will open the URL you entered, and the Workflow Manager will be shown above the browser, then you can design the task freely.
[Notice] The first operation in the Workflow Manager should be "Open Page", if not because of the network delay, please close the Workflow Manager and click "Start Design" Button again.
You need to select element(s) at the web browser by right-click your mouse, then set task operation(s) by following the toolbox in the browser by left-click. Your defined operations will then be shown in the Workflow Manager, please refer to subsequent pages in this documentation see the details of every operation.
After finished designing the task, click the "Save Task" Button in the top of the Workflow Manager Toolkit to save the task:
Click the "View/Manage/Invoke Tasks" button at the main UI of EasySpider, and click "Task Information" link to view the information of the task in the task list:
Click "Modify Task" Button to view and modify the task workflow, here you can only change properties of the workflow, use the clipboard to cut, copy, delete the operations:
If you want to add more operations based on the web page, please use "Modify Task" link in the task list by clicking the "Design Task" Button in the main UI:
Click the "Invoke Task" Button at the task information Page to invoke the task:
You can change input parameters to your own needs, and click the "Directly Run locally" button to run the task locally:
Wait the task to be executed automatically:
And see the final collected results in the "Data" folder, which is a ".csv" file:
Note the current version uses author's own server, therefore task information will be saved there without any authentication (password) thus everyone from the Internet can access it. Please build your own web server by the code in the folder "ServiceGrid" with MongoDB database to make your task information saved in your own machines.
After you build your own server, change the "frontEndAddress" and "backEndAddress" item in the "config.ini" configuration file to your own server addresses.
In the near future, the software will support _Local Mode, which means all task information will be saved to user's local machine instead of a web server, then you do not need to build a web server to use the software.
When encountered any errors from the software, close all windows of the software and restart it. If problem still exists, please contact the author by email for assistance.