Skip to content

Our project focus on building a pipeline which can ingest Facebook comments from posts. Then, we classify them into hatespeech, discriminate, personal-attack and others by applying an ML and DL model.

Notifications You must be signed in to change notification settings

boo283/NEGATIVE-SOCIAL-MEDIA-COMMENTS-CLASSIFICATION

Repository files navigation

NEGATIVE SOCIAL MEDIA COMMENTS CLASSIFICATION

Our project focuses on building an end-to-end system to automatically crawl Facebook comments data and classify them into four labels: Hate speech, Personal Attack, Discrimination, Others. Total

Main Fuction

  • Scrape comments with related information such as:
    • Comment - text
    • User
    • Nametag (like @name_tag)
    • Check if it is spam (based on user-defined demand)
    • Via https://github.com/boo283/Facebook_comment_crawler.git
  • Preprocess data:
    • Follow these steps: Preprocess
  • Make classification and visualize the results:
    • Use HSD model (base on ML model) to predict
    • Visualize data using Streamlit

Installation

  • Clone the repository git clone https://github.com/boo283/Facebook_comment_crawler.git git clone https://github.com/boo283/NEGATIVE-SOCIAL-MEDIA-COMMENTS-CLASSIFICATION.git
  • Install dependencies: pip install -r requirements.txt

Usage

  1. Clone this repository
  2. Open this repository and add some information:
  • Crawler
  • In folder "configuration":
  • In main folder:
    • crawl.py:
      • Just type your Facebook account in the Login info part in main function.
      • Choose your destination to save crawled data
  • App.py:
    • Create kafka-topic "StreamComments"
    • Adjust paths in python files
  1. Cd to folder and run script: python app.py
  2. Simply enter the Facebook URL post, Account information and choose Featch and analyze The result will like: rs

Contact:

Feel free to adjust my code, practice makes perfect ❤️❤️❤️

About

Our project focus on building a pipeline which can ingest Facebook comments from posts. Then, we classify them into hatespeech, discriminate, personal-attack and others by applying an ML and DL model.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages