groqchat

A terminal chatbot, powered by Groq Cloud API (Windows / MacOS / Linux)

A simple chatbot that runs fast on Mac Linux and Windows.

Groq API Key

from www.groq.com

Installation

With python installed, setup gropchat via pip:

pip install rgroq

Get Started

Simply run 'rgroq':

gchat

Enter your Groq cloud a single API key or a list of multiple API keys:
(Remarks: If a list of multiple API keys are entered, entered API keys are automatically rotated for running inference.)

Select a model:

Special Entries

Enter a dot '.' to display available special entries:

'.new' - start a new chart session

'.api' - change api key

'.model' - change model

'.systemmessage' - change system message

'.temperature' - change temperature

'.maxtokens' - change max tokens

'.togglewordwrap' - toggle word wrap

'.togglevoiceoutput' - toggle voice output

'.exit' - exit the application

Keyboard Shortcuts

By default:

Ctrl+Z - cancel

Ctrl+Q - exit / quit

Ctrl+I / TAB - insert new line

Ctrl+N - new chat session

Ctrl+W - toggle word wrap

Ctrl+Y - toggle voice output

Ctrl+S - trigger voice typing

Configurations

Advanced users may change configurations manually by editing the file "config.py" located in the package folder.

Remarks: Close the app before editing the file.

CLI Options

Run 'gchat --help' for cli options

gchat --help

For example, to start with a greeting:

gchat "Hi!"

For example, to set temperature to 0.8 and maximum output tokens to 1024, run:

gchat -t 0.8 -o 1024 "Hi!"

Install Multiple Copies

You may want to install multiple copies to customise them with different system messages or other settings.

An easy way to achieve it is to use alias, e.g.:

mkdir apps

cd apps

python3 -m venv assist explain quote illustrate summarize

source assist/bin/activate

pip install gchat

source explain/bin/activate

pip install gchat

source quote/bin/activate

pip install gchat

source illustrate/bin/activate

pip install gchat

source summarize/bin/activate

pip install gchat

nano .bashrc

Add the following aliases:

alias explain=$HOME/apps/explain/bin/gchat
alias illustrate=$HOME/apps/illustrate/bin/gchat
alias quote=$HOME/apps/quote/bin/gchat
alias assist=$HOME/apps/assist/bin/gchat
alias summarize=$HOME/apps/summarize/bin/gchat