-
Notifications
You must be signed in to change notification settings - Fork 1.5k
Open
Labels
Description
Hi! I am currently integrating Cutlass EVT into an MLIR-based deep learning compiler to address arbitrary epilogue fusion issues. The deep learning compiler uses stablehlo as the frontend. I am attempting to translate stablehlo ops into a Python Ast frontend, integrating the Cutlass-generated kernel as a custom call into the compiler. I have encountered the following issues during this process and would like to hear some suggestions:
- In stablehlo, activation functions need to be decomposed into basic operator representations, so the ReLU activation function becomes stablehlo.max. However, the operations supported by the EVT python ast frontend are limited; to my knowledge, it only supports addition, subtraction, multiplication, division, and some activation functions. Do you have any good solutions? Do you have a plan to extend the python ast frontend?
- Constructing EVTD::arguments is quite challenging. I am currently deducing the construction method for EVTD::arguments by parsing ctypes.structure in Python. Do you have any good solutions?