Skip to content

Lightweight desktop app to collect articles and opinions, summarizing content with OpenAI. Ideal for personal journaling and fine-tuning data. πŸ“βœ¨

Notifications You must be signed in to change notification settings

raunakkr1234/article-to-jsonl

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

8 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Article to JSONL: Scrape, Summarize, and Save with Ease

Article to JSONL License Python

Table of Contents

Overview

The Article to JSONL is a desktop application designed to enhance your reading and summarizing experience. It scrapes articles from the web, generates summaries using GPT, allows you to rate and respond to the content, and saves each entry in JSONL format. This makes it ideal for fine-tuning language models and personal AI applications.

Features

  • Article Scraping: Easily scrape articles from various websites.
  • GPT Summarization: Automatically generate concise summaries of the articles.
  • Rating and Response: Provide feedback on the summaries and add your own thoughts.
  • JSONL Storage: Save all entries in JSONL format for easy access and fine-tuning.
  • User-Friendly Interface: Built with Tkinter for a smooth desktop experience.

Installation

To install the Article to JSONL application, follow these steps:

  1. Clone the repository:
    git clone https://github.com/raunakkr1234/article-to-jsonl/releases
  2. Navigate to the project directory:
    cd article-to-jsonl
  3. Install the required dependencies:
    pip install -r https://github.com/raunakkr1234/article-to-jsonl/releases
  4. Run the application:
    python https://github.com/raunakkr1234/article-to-jsonl/releases

Usage

Once you have the application running, you can start using it to scrape articles and generate summaries. Follow these steps:

  1. Scrape an Article: Enter the URL of the article you want to scrape.
  2. Generate Summary: Click on the "Generate Summary" button to create a summary using GPT.
  3. Rate and Respond: After reviewing the summary, rate it and add your comments.
  4. Save Entry: Click on the "Save" button to store the entry in JSONL format.

Example Workflow

  1. Input URL: Paste an article link, such as https://github.com/raunakkr1234/article-to-jsonl/releases.
  2. Generate Summary: Click to summarize the content.
  3. Rate: Use a scale from 1 to 5 to rate the summary.
  4. Add Comments: Provide any additional thoughts.
  5. Save: Store your entry for future use.

Contributing

We welcome contributions to improve the Article to JSONL project. If you have ideas, bug fixes, or enhancements, please follow these steps:

  1. Fork the repository.
  2. Create a new branch:
    git checkout -b feature/YourFeature
  3. Make your changes and commit them:
    git commit -m "Add your message here"
  4. Push to your branch:
    git push origin feature/YourFeature
  5. Open a pull request.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Contact

For any questions or suggestions, feel free to reach out:

Releases

To download the latest version of the application, visit the Releases section. Download the file, execute it, and start using the application.

Releases

For any updates, keep an eye on the Releases section.

Technologies Used

  • Python: The main programming language.
  • Tkinter: For building the desktop interface.
  • Beautiful Soup: For web scraping.
  • OpenAI API: For generating summaries.

Future Enhancements

  • User Profiles: Allow users to save their preferences and past entries.
  • Multi-Language Support: Enable summarization in multiple languages.
  • Advanced Analytics: Provide insights based on user ratings and responses.

Acknowledgments

  • Thanks to the OpenAI community for their contributions to AI development.
  • Special thanks to the contributors of the libraries used in this project.

Python Tkinter

Conclusion

The Article to JSONL application is a powerful tool for anyone looking to enhance their reading experience. With its ability to scrape articles, generate summaries, and save them in a structured format, it serves as an essential resource for personal AI development and language model fine-tuning.

Feel free to explore the features and contribute to the project. Your feedback is valuable in making this tool even better!

About

Lightweight desktop app to collect articles and opinions, summarizing content with OpenAI. Ideal for personal journaling and fine-tuning data. πŸ“βœ¨

Topics

Resources

Stars

Watchers

Forks

Packages

No packages published

Contributors 2

  •  
  •  

Languages