-
-
Notifications
You must be signed in to change notification settings - Fork 8.9k
bump flashinfer
to v0.2.8
#21385
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
bump flashinfer
to v0.2.8
#21385
Conversation
👋 Hi! Thank you for contributing to the vLLM project. 💬 Join our developer Slack at https://slack.vllm.ai to discuss your PR in #pr-reviews, coordinate on features in #feat- channels, or join special interest groups in #sig- channels. Just a reminder: PRs would not trigger full CI run by default. Instead, it would only run Once the PR is approved and ready to go, your PR reviewer(s) can run CI to test the changes comprehensively before merging. To run CI, PR reviewers can either: Add 🚀 |
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request updates the flashinfer
dependency version from a release candidate (v0.2.8rc1
) to the final stable release (v0.2.8
) within the Dockerfile. The change is minimal, correct, and aligns with the stated purpose of using the latest stable version of the library. I see no issues with this update.
Thank you for the bump! |
CI failures in basic model tests are fixed in #21375. |
@mgoin It seems TPU test has timed out and all other tests pass. |
Essential Elements of an Effective PR Description Checklist
Purpose
Bump flashinfer version in official vllm docker image to
v0.2.8
, the latest stable release.flashinfer==0.2.8
includes a QoL update for nonstandard NVSHMEM location support, which is especially useful for vllm users experimenting with expert parallelism by stacking EP libraries on top of vllm docker image.Test Plan
docker build CI is green
Test Result
TBD