Skip to content

[QST] Integrating Cutlass EVT to MLIR-Based compiler problems #1807

@Xinyu302

Description

@Xinyu302

Hi! I am currently integrating Cutlass EVT into an MLIR-based deep learning compiler to address arbitrary epilogue fusion issues. The deep learning compiler uses stablehlo as the frontend. I am attempting to translate stablehlo ops into a Python Ast frontend, integrating the Cutlass-generated kernel as a custom call into the compiler. I have encountered the following issues during this process and would like to hear some suggestions:

  1. In stablehlo, activation functions need to be decomposed into basic operator representations, so the ReLU activation function becomes stablehlo.max. However, the operations supported by the EVT python ast frontend are limited; to my knowledge, it only supports addition, subtraction, multiplication, division, and some activation functions. Do you have any good solutions? Do you have a plan to extend the python ast frontend?
  2. Constructing EVTD::arguments is quite challenging. I am currently deducing the construction method for EVTD::arguments by parsing ctypes.structure in Python. Do you have any good solutions?

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions