Skip to content

Special optimization for torch backend #21313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
pass-lin opened this issue May 21, 2025 · 1 comment
Open

Special optimization for torch backend #21313

pass-lin opened this issue May 21, 2025 · 1 comment
Assignees
Labels
stat:contributions welcome A pull request to fix this issue would be welcome. type:feature The user is asking for a new feature.

Comments

@pass-lin
Copy link
Contributor

pass-lin commented May 21, 2025

PyTorch provides specialized cudnn operators for many common implementations, such as F.group_norm

In the past speed test benchmarks of the keras-team, we can also find that the torch backend of keras is usually slower than the native torch backend. This may be related to the fact that many implementations in keras do not use the cudnn operators provided by torch.

Is it necessary to make some special optimizations for the torch backend for the existing layer implementation to improve the inference performance of the torch backend.

If necessary, we can submit a PR.

@dhantule dhantule added the type:feature The user is asking for a new feature. label May 21, 2025
@sonali-kumari1 sonali-kumari1 added the keras-team-review-pending Pending review by a Keras team member. label May 21, 2025
@divyashreepathihalli divyashreepathihalli added stat:contributions welcome A pull request to fix this issue would be welcome. and removed keras-team-review-pending Pending review by a Keras team member. labels May 22, 2025
@divyashreepathihalli
Copy link
Collaborator

@pass-lin Thank you!! Please feel free to submit your contribution for these optimizations! Thank you!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
stat:contributions welcome A pull request to fix this issue would be welcome. type:feature The user is asking for a new feature.
Projects
None yet
Development

No branches or pull requests

5 participants