"llama.cpp perplexity scorecard": a llama.cpp helper project

[ianscrivener]

llama-cpp-perplexity-scorecard

A response to @ggerganov's call for perplexity and latency testing for llama.cpp: "llama.cpp perplexity scorecard" is : a helper project to run and gather ./perplexity results - collecting the results for review and analysis.

Results are uploaded to AWS S3 as JSON: eg https://llama-cpp-perplexity-logs.s3.amazonaws.com/px_20230721T231314Z_71fbbcf6.json

Soon I'll do some Jupyter examples of scoreboard, tables, charts... contributions are very welcome!