[QST] Support for Ada Lovelace Architecture

[VarunMohan]

It was mentioned that the 40 series has access to the Hopper transformer engine. What is the timeline for adding cutlass support for Ada hardware. I noticed that the TransformerEngine project also does not have support yet as well.

[hwu36]

Ada is sm89, still ampere class chip. Existing cutlass ampere kernels should just work as long as you use sm89 in the cmake.

[VarunMohan]

It was stated that Ada could perform computations in fp8. I was wondering when that would be available on Cutlass

[hwu36]

@mnicely

[mnicely]

Hi @VarunMohan, excited to see your interest in CUTLASS and our new hardware. We are still finalizing our roadmap and will get back to you shortly. Do you mind providing any insight to your requirements and use case?

[VarunMohan]

Hi @mnicely, I wanted to try out some fp8 computations on the 40 series before we could get access to hardware in the Hopper generation.

[github-actions]

This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.

[ankan-ban]

Another use case: The Leela chess zero project (https://lczero.org/) is also waiting for FP8 support to be available on Ada GPUs. They use custom inference code written in Cuda (and using cublas library) and there is interest in trying out cutlass to get access to new Ada features.

[github-actions]

This issue has been labeled inactive-30d due to no recent activity in the past 30 days. Please close this issue if no further response or action is needed. Otherwise, please respond with a comment indicating any updates or changes to the original issue and/or confirm this issue still needs to be addressed. This issue will be labeled inactive-90d if there is no activity in the next 60 days.