Skip to content

sham-nt/job_scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Job listings Web-scrapper

              using Python, BeautifulSoup4 & selenium

About

The internet is filled with sites with many job hunting sites, and many of them contain a lot of fluff which is not relevant to the average job-seeker ... so, I am building this project to scrape few popular job listing sites to get their combined jobs

Initially i will be scrapping the 3 sites

  • TimesJobs.com
  • Naukri.com
  • Indeed.com

Screenshot 2023-02-15 at 9 26 19 PM Screenshot 2023-02-15 at 9 42 07 PM times_jobs


Dependancies

If u want to setup this project in your local system

  1. Install or update the following libraries

                   pip install beautifulsoup4
                   pip install lxml
                   pip install requests
                   pip install selenium
    
  2. Download the chrome driver specific to your system at https://chromedriver.chromium.org/ , and store it in a easily accessable path

  3. replace the chrome_drive path in the func.py

  4. execute main.py

  5. Enjoy 😁


Roadmap to project

  1. Build initial implementation for Timesjobs.com
  2. complete the implementation of Naukri.com
  3. Store the scrapped data in a database
  4. build a front end for viewing the data
  5. fetch the data to the front end in realtime

About

A webscraper to find job listings based on skills known

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages