Skip to content

Migrate the app (ktransformers) to SYCL/oneAPI #2684

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
zhimingwang36 opened this issue Feb 28, 2025 · 2 comments
Open

Migrate the app (ktransformers) to SYCL/oneAPI #2684

zhimingwang36 opened this issue Feb 28, 2025 · 2 comments

Comments

@zhimingwang36
Copy link
Contributor

Target to migrate https://github.com/kvcache-ai/ktransformers.git to SYCL with the SYCLomatic tool: Analysis the migration gap, and fix the migration gap if possible.

  1. Migrate each CUDA file to SYCL file with the SYCLomatic tool.

  2. Build the SYCL file with SYCL compiler, fix the issues manually.

    a. For API/ASM not supported by the tool, it’s better to manual write an equal functionality with SYCL/oneAPI lib (which can be used to extent the migration capability of SYCLomatic).
    b. Or, Just comment out to make sure other code build well if SYCL/oneAPI side doesn’t have similar functionality.

  3. Report migration issue if there is CUDA code does not migrate well.

    a. It’s better to have small reproducer for each migration issues.

  4. Doc the migration steps and manual fix details.

a. Ref to readme file available in: https://github.com/oneapi-src/SYCLomatic-test/tree/SYCLomatic/third-party-programs/Velocity-Bench

  1. Commit the migration as test case into SYCLomatic-test repo.

a. Ref to: https://github.com/oneapi-src/SYCLomatic-test/tree/SYCLomatic/third-party-programs/Velocity-Bench

  1. For issues in step3, fix in SYCLomaitc if possible with some guide.
@chengxiw
Copy link

chengxiw commented Mar 3, 2025

SYCLomaticTeam1 working on this issue

zhimingwang36 pushed a commit that referenced this issue Mar 7, 2025
Add mem buffer operations to command buffer v2
@chengxiw
Copy link

chengxiw commented Mar 7, 2025

Hi @zhimingwang36 , we created a PR to migrate one kernel of ktransformers "dequant.cu", in this PR oneapi-src/SYCLomatic-test#879, we are not familiar with open-source license so we didn't add license txt in the PR. Can you help with it?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants