Blockwise FP8 Scaling on B200

[danteisalive]

Is Blockwise FP8 scaling with CUDA_R_32F scale data type that is added for SM90 supported on B200 too?

[rsdubtso]

Hi @danteisalive, thanks for the question. The CUBLASLT_MATMUL_MATRIX_SCALE_OUTER_VEC_32F, CUBLASLT_MATMUL_MATRIX_SCALE_VEC128_32F and CUBLASLT_MATMUL_MATRIX_SCALE_BLK128x128_32F are currently only supported on SM90. Please refer to this table in the documentation. The SM100+ supports CUBLASLT_MATMUL_MATRIX_SCALE_VEC32_UE8M0.

[danteisalive]

Thanks!