Watercrawl-OpenAI Plugin

version: 0.0.1 author: Watercrawl

Description

This plugin allows you to use OpenAI's LLM to extract information from crawled content.

Installation

You can install this plugin using pip:

pip install watercrawl-openai

Usage

To use this plugin in your Watercrawl project, import it as follows:

In the WaterCrawl project environments add the following:

WATER_CRAWL_PLUGINS="watercrawl_openai.OpenAIPlugin,...rest_of_plugins"

Configuration

Make sure to set the following environment variables:

OPENAI_API_KEY="Your OpenAI API key"
EXTRACT_SYSTEM_PROMPT="Your system prompt"

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Links

GitHub: https://github.com/watercrawl/watercrawl-openai