Skip to content

Add Docker and Kubernetes Support for GuideLLM Benchmarking #119

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wangchen615 opened this issue Apr 17, 2025 · 0 comments · May be fixed by #123
Open

Add Docker and Kubernetes Support for GuideLLM Benchmarking #119

wangchen615 opened this issue Apr 17, 2025 · 0 comments · May be fixed by #123

Comments

@wangchen615
Copy link

We need a dockerfile to enable running GuideLLM benchmarks in a containerized environment and as a Kubernetes job. This would be helpful for users who want to run benchmarks in a more controlled and scalable environment.

The first change should include:

Dockerfile

  • Based on Python 3.11 slim image
  • Installs GuideLLM and its dependencies
  • Entrypoint to run benchmarks with environment variables
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: In progress
Development

Successfully merging a pull request may close this issue.

1 participant