xlite-dev

All

24 repositories

LeetCUDA
Public
📚LeetCUDA: Modern CUDA Learn Notes with PyTorch for Beginners, 200+ CUDA & Tensor Cores Kernels, HGEMM, FA-2 MMA etc.🔥
cuda cuda-kernels cuda-demo cuda-toolkit cuda-library cuda-kernel learn-cuda cuda-cpp hgemm flash-attention
Cuda
•
GNU General Public License v3.0
•508•4.7k•4•0•Updated Jun 10, 2025Jun 10, 2025
Awesome-LLM-Inference
Public
📚A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, Parallelism, MLA, etc.
mla vllm llm-inference awesome-llm flash-attention tensorrt-llm paged-attention deepseek flash-attention-3 deepseek-v3
Python
•
GNU General Public License v3.0
•283•4.1k•1•0•Updated Jun 9, 2025Jun 9, 2025
Awesome-DiT-Inference
Public
📚A curated list of Awesome Diffusion Inference Papers with codes: Sampling, Caching, Multi-GPUs, etc. 🎉🎉
gpu inference vit diffusion dit multi-gpus sora stable-diffusion sdxl sd15
GNU General Public License v3.0
•15•258•0•0•Updated Jun 8, 2025Jun 8, 2025
torchlm
Public
💎A high level pipeline for face landmarks detection: train, eval, inference (Python/C++) and 100+ data augmentations.
heatmap regression pip data-augmentation face-landmarks mobilenet shufflenet torchvision albumentations yolov5
Python
•
MIT License
•24•260•14•0•Updated Jun 8, 2025Jun 8, 2025
lite.ai.toolkit
Public
🛠 A lite C++ AI toolkit: 100+🎉 models (Stable-Diffusion, FaceFusion, YOLO series, Det, Seg, Matting) with MNN, ORT and TensorRT.
tensorrt mnn ncnn onnx onnxruntime yolov5 tnn mnn-model yolox robustvideomatting
C++
•
GNU General Public License v3.0
•743•4.1k•0•0•Updated May 30, 2025May 30, 2025
SpargeAttn
Public
SpargeAttention: A training-free sparse attention that can accelerate any model inference.
Cuda
•
Apache License 2.0
•41•6•0•0•Updated May 24, 2025May 24, 2025
SageAttention
Public
Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.
Cuda
•
Apache License 2.0
•120•0•0•0•Updated May 24, 2025May 24, 2025
lihang-notes
Public
📚《统计学习方法-李航: 笔记-从原理到实现》这是一份非常详细的学习笔记，200页PDF，各种手推公式细节讲解以及R语言实现. 🎉
svm kd-tree ml statistics-learning lihang li-hang lihang-code lihang-notes li-hang-notes
Shell
•
GNU General Public License v3.0
•57•463•2•0•Updated May 17, 2025May 17, 2025
.github
Public
0•1•0•0•Updated May 17, 2025May 17, 2025
HGEMM
Public
⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.
cuda tensor-cores hgemm
Cuda
•
GNU General Public License v3.0
•4•79•0•0•Updated May 10, 2025May 10, 2025
ffpa-attn
Public
📚FFPA(Split-D): Extend FlashAttention with Split-D for large headdim, O(1) GPU SRAM complexity, 1.8x~3x↑🎉 faster than SDPA EA.
cuda attention sdpa mla mlsys tensor-cores flash-attention deepseek deepseek-v3 deepseek-r1
Cuda
•
GNU General Public License v3.0
•8•185•3•0•Updated May 10, 2025May 10, 2025
xlite-cli
Public
The cli version of lite.ai.toolkit
C++
•0•1•0•0•Updated Apr 9, 2025Apr 9, 2025
flashinfer
Public
FlashInfer: Kernel Library for LLM Serving
Cuda
•
Apache License 2.0
•325•0•0•0•Updated Mar 23, 2025Mar 23, 2025
tutorial-template
Public template
Template for the Read the Docs tutorial
Python
•1.6k•0•0•0•Updated Aug 9, 2024Aug 9, 2024
RVM-Inference
Public
🔥Robust Video Matting C++ inference toolkit with ONNXRuntime、MNN、NCNN and TNN, via lite.ai.toolkit.
cpp matting mnn ncnn onnx onnxruntime tnn robustvideomatting
C++
•
GNU General Public License v3.0
•27•126•20•0•Updated Jul 29, 2024Jul 29, 2024
netron-vscode-extension
Public
☕️ A vscode extension for netron, support *.pdmodel, *.nb, *.onnx, *.pb, *.h5, *.tflite, *.pth, *.pt, *.mnn, *.param, etc.
deeplearning paddle mnn ncnn onnx onnxruntime yolov5 tnn netron yolov8
TypeScript
•
Other
•0•13•3•0•Updated Jun 4, 2023Jun 4, 2023
yolov5face-toolkit
Public
YOLO5Face 2021 with MNN/NCNN/TNN/ONNXRuntime
cpp yolov5-face-landmark yolo5face yolov5face yolov5-face yolo5-face yolov7-face yolov8-face
C++
•
GNU General Public License v3.0
•8•57•6•0•Updated Apr 21, 2023Apr 21, 2023
ssrnet-toolkit
Public
SSRNet: 190 Kb!! Super fast Age Estimation with MNN/TNN/ONNXRuntime C++.
ssrnet
C++
•
GNU General Public License v3.0
•0•3•0•0•Updated Feb 4, 2022Feb 4, 2022
fsanet-toolkit
Public
FSANet: 1 Mb!! Head Pose Estimation with MNN、TNN and ONNXRuntime C++.
fsanet
C++
•
GNU General Public License v3.0
•2•17•0•0•Updated Feb 4, 2022Feb 4, 2022
mgmatting-toolkit
Public
MGMatting with MNN/TNN/ONNXRuntime C++, GPU/CPU, support dynamic shape.
cpp matting mnn onnxruntime tnn mgmatting
C++
•
GNU General Public License v3.0
•2•7•1•0•Updated Feb 3, 2022Feb 3, 2022
scrfd-toolkit
Public
Super fast accurate face detector ! SCRFD(CVPR 2021) with MNN/TNN/NCNN/ONNXRuntime C++.
mnn ncnn onnxruntime tnn scrfd
C++
•
GNU General Public License v3.0
•3•17•0•0•Updated Jan 12, 2022Jan 12, 2022
nanodet-toolkit
Public
NanoDet、NanoDet-Plus with ONNXRuntime/MNN/TNN/NCNN C++.
mnn ncnn onnxruntime tnn nanodet
C++
•
GNU General Public License v3.0
•7•26•2•0•Updated Dec 27, 2021Dec 27, 2021
yolox-toolkit
Public
YOLOX with NCNN/MNN/TNN/ONNXRuntime C++.
yolox
C++
•
GNU General Public License v3.0
•1•13•1•0•Updated Dec 18, 2021Dec 18, 2021
yolop-toolkit
Public
YOLOP with ONNXRuntime C++/MNN/TNN/NCNN
mnn ncnn onnxruntime tnn yolop
C++
•
GNU General Public License v3.0
•0•8•0•0•Updated Dec 18, 2021Dec 18, 2021