Skip to content

A web application scrapes various websites for the Mission to Mars data and displays the information on an HTML page.

Notifications You must be signed in to change notification settings

Karla-Flores/Web-Scraping

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 

Repository files navigation

Web-Scraping--Challenge



Goal

The purpose of this challenge was to create BeautifulSoup, Splinter, and Pandas to scrape five different web pages related to Mars and display the results on a webpage using MongoDB and Flask to demonstrate an effective web app to house data regarding Mars' weather, hemispheres, latest news, and facts. It is also meant to update as time goes on, meaning when new articles hit the Mars NASA page, the web app will update on its own, bringing further information to the app users.


Process




Scraping Mars Data

A web application was built that scrapes data from five different websites to gather data related to the Mission to Mars and displays the information in a single HTML page.

Flask

A python script to run all of the scraping code was designed, and all of the scraped data was put into one Python dictionary. The function /scrape' set up a route that will import the Python script and call the scrape function was created and displayed on the index.html.

Mongo DB

A new database and a new collection were created, and all of the scraped data was stored in the above-created database. The root route / will query the database and pass the mars data into the HTML template was made.

About

A web application scrapes various websites for the Mission to Mars data and displays the information on an HTML page.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published