This repository includes a test script used to check the possibility to validate an LLM inference by checking the single tokens of the LLM output.
The script is on the two branch:
- batch-mistral: script used to test the Mistral model
- batch-deepseek: script used to test the DeepSeek model