Skip to content

Fix scaled_mm_rowwise in quantize_bench #4551

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

cthi
Copy link
Contributor

@cthi cthi commented Jul 23, 2025

Summary:
X-link: https://github.com/facebookresearch/FBGEMM/pull/1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Differential Revision: D78844879

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78844879

Copy link

netlify bot commented Jul 23, 2025

Deploy Preview for pytorch-fbgemm-docs ready!

Name Link
🔨 Latest commit 7b68209
🔍 Latest deploy log https://app.netlify.com/projects/pytorch-fbgemm-docs/deploys/688238ef103740000751fe1d
😎 Deploy Preview https://deploy-preview-4551--pytorch-fbgemm-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@cthi cthi force-pushed the export-D78844879 branch from 1126796 to 87b7ac2 Compare July 24, 2025 13:06
cthi added a commit to cthi/FBGEMM-1 that referenced this pull request Jul 24, 2025
Summary:

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
cthi added a commit to cthi/FBGEMM-1 that referenced this pull request Jul 24, 2025
Summary:

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
@cthi cthi force-pushed the export-D78844879 branch 2 times, most recently from ee532a8 to 5964585 Compare July 24, 2025 13:08
cthi added a commit to cthi/FBGEMM-1 that referenced this pull request Jul 24, 2025
Summary:

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
cthi added a commit to cthi/FBGEMM-1 that referenced this pull request Jul 24, 2025
Summary:

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
@cthi cthi force-pushed the export-D78844879 branch from 5964585 to 105c5d7 Compare July 24, 2025 13:09
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78844879

cthi added a commit to cthi/FBGEMM-1 that referenced this pull request Jul 24, 2025
Summary:
Pull Request resolved: pytorch#4551

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
@cthi cthi force-pushed the export-D78844879 branch from 105c5d7 to 8a02b00 Compare July 24, 2025 13:11
cthi added a commit to cthi/FBGEMM-1 that referenced this pull request Jul 24, 2025
Summary:

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
@cthi cthi force-pushed the export-D78844879 branch from 8a02b00 to 65829a2 Compare July 24, 2025 13:22
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78844879

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78844879

cthi added a commit to cthi/FBGEMM-1 that referenced this pull request Jul 24, 2025
Summary:
Pull Request resolved: pytorch#4551

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
@cthi cthi force-pushed the export-D78844879 branch from 65829a2 to 3a6cd99 Compare July 24, 2025 13:24
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78844879

cthi added a commit to cthi/FBGEMM-1 that referenced this pull request Jul 24, 2025
Summary:
Pull Request resolved: pytorch#4551

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
@cthi cthi force-pushed the export-D78844879 branch from 3a6cd99 to cbaf7ed Compare July 24, 2025 13:33
Summary:
Pull Request resolved: pytorch#4551

X-link: facebookresearch/FBGEMM#1594

When looking at this with samanamp recently I noticed the scaled_mm is not actually using the rowwise scaling with it, I think this was before it was supported properly.

We also add support for compile, which will be useful for testing.

Reviewed By: jianyuh

Differential Revision: D78844879
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D78844879

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in f509911.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants