using Python, BeautifulSoup4 & selenium
The internet is filled with sites with many job hunting sites, and many of them contain a lot of fluff which is not relevant to the average job-seeker ... so, I am building this project to scrape few popular job listing sites to get their combined jobs
Initially i will be scrapping the 3 sites
- TimesJobs.com
- Naukri.com
- Indeed.com
If u want to setup this project in your local system
-
Install or update the following libraries
pip install beautifulsoup4 pip install lxml pip install requests pip install selenium
-
Download the chrome driver specific to your system at https://chromedriver.chromium.org/ , and store it in a easily accessable path
-
replace the chrome_drive path in the func.py
-
execute main.py
-
Enjoy 😁
- Build initial implementation for Timesjobs.com ✅
- complete the implementation of Naukri.com ✅
- Store the scrapped data in a database
- build a front end for viewing the data
- fetch the data to the front end in realtime