The purpose of this challenge was to create BeautifulSoup, Splinter, and Pandas to scrape five different web pages related to Mars and display the results on a webpage using MongoDB and Flask to demonstrate an effective web app to house data regarding Mars' weather, hemispheres, latest news, and facts. It is also meant to update as time goes on, meaning when new articles hit the Mars NASA page, the web app will update on its own, bringing further information to the app users.
Scraping Mars Data
A web application was built that scrapes data from five different websites to gather data related to the Mission to Mars and displays the information in a single HTML page. |
|
Flask
A python script to run all of the scraping code was designed, and all of the scraped data was put into one Python dictionary. The function /scrape' set up a route that will import the Python script and call the scrape function was created and displayed on the index.html. |
|
Mongo DB
A new database and a new collection were created, and all of the scraped data was stored in the above-created database. The root route / will query the database and pass the mars data into the HTML template was made. |