Skip to content

Commit 2a18e60

Browse files
committed
[Feat]: Add support for kleidiai quantization schemes
Description: 1. Allow Int4WeightOnlyQuantizer to work with channelwise and groupwise symmetric quantization schemes 2. KleidiAI supports channelwise and 32 groupwise quantized matmul kernels Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
1 parent 4738377 commit 2a18e60

File tree

2 files changed

+354
-60
lines changed

2 files changed

+354
-60
lines changed

0 commit comments

Comments
 (0)