NewAlpha: Stock News Extrator

NewAlpha is a web application built using Streamlit that summarizes news articles related to stocks. It utilizes LangChain's UnstructuredURLLoader to fetch data from websites, then employs RecursiveCharacterTextSplitter to split the text into segments for analysis. The text segments are embedded into vectors using OpenAIEmbeddings and stored in a FAISS database for efficient retrieval.

Features

• Summarizes news articles related to stocks.
• Provides important details without the need to read the entire article.
• Utilizes LangChain's UnstructuredURLLoader for fetching data from websites.
• Employs RecursiveCharacterTextSplitter for segmenting the text.
• Embeds text segments into vectors using OpenAIEmbeddings.
• Stores embedded vectors in a FAISS database for efficient retrieval.
• Loads OpenAI's LLM model for question answering based on the provided text.

Installation

1. Clone the repository:

git clone https://github.com/whoisusmanali/NewsAlpha

2. Install dependencies:

cd newalpha
pip install -r requirements.txt

Usage

Run the Streamlit app:

streamlit run app.py

Access the application via the provided URL.

• Enter the URL of the news article you want to summarize.
  
• Wait for the summarization process to complete.
  
• View the summarized content and important details regarding the stocks mentioned in the article.
  

Dependencies

• Streamlit: for building the web application.
  
• LangChain: for fetching data from websites and text processing.
  
• OpenAI: for text embeddings and question answering capabilities.
  
• FAISS: for efficient vector storage and retrieval.