Skip to content

@IST-DASLab IST Austria Distributed Algorithms and Systems Lab

Change the repository type filter

All

    Repositories list

    63 repositories

    • FP-Quant

      Public
      Python
      •0•23•1•1•Updated Aug 9, 2025Aug 9, 2025

    • EvoPress

      Public
      Python
      •2•26•0•0•Updated Jul 30, 2025Jul 30, 2025

    • qutlass

      Public
      QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning
      C++
      •
      Apache License 2.0
      •2•62•1•0•Updated Jul 15, 2025Jul 15, 2025

    • ISTA-DASLab-Optimizers

      Public
      Python
      •
      Apache License 2.0
      •0•9•0•0•Updated Jun 30, 2025Jun 30, 2025

    • QuEST

      Public
      Work in progress.
      Jupyter Notebook
      •
      MIT License
      •6•70•2•0•Updated Jun 29, 2025Jun 29, 2025

    • Quartet

      Public
      Jupyter Notebook
      •
      MIT License
      •6•76•4•0•Updated Jun 27, 2025Jun 27, 2025

    • Yolov8-Pose-Detection-on-Browser

      Public
      Example of YOLOv8 pose detection (estimation) on browser. It shows implementations powered by ONNX and TFJS served through JavaScript without any frameworks. It demonstrates pose detection (estimation) on image as well as live web camera,
      HTML
      •
      MIT License
      •3•0•0•0•Updated Jun 13, 2025Jun 13, 2025

    • MoE-Quant

      Public
      Code for data-aware compression of DeepSeek models
      Python
      •6•42•2•0•Updated Jun 10, 2025Jun 10, 2025

    • influence_distillation

      Public
      Official implementation of Influence Distillation: https://www.arxiv.org/abs/2505.19051
      Python
      •0•3•1•0•Updated May 29, 2025May 29, 2025

    • PanzaMail

      Public
      Python
      •
      Apache License 2.0
      •19•292•4•6•Updated Apr 8, 2025Apr 8, 2025

    • HALO-anon

      Public
      0•0•0•0•Updated Apr 1, 2025Apr 1, 2025

    • torch_cgx

      Public
      Pytorch distributed backend extension with compression support
      C++
      •
      GNU Affero General Public License v3.0
      •0•16•4•0•Updated Mar 24, 2025Mar 24, 2025

    • gemm-int8

      Public
      High Performance Int8 GEMM Kernels for SM80 and later GPUs.
      Python
      •
      MIT License
      •0•9•0•0•Updated Mar 11, 2025Mar 11, 2025

    • DarwinLM

      Public
      Official Pytorch Implementation of Paper "DarwinLM: Evolutionary Structured Pruning of Large Language Models"
      Python
      •3•16•0•0•Updated Feb 21, 2025Feb 21, 2025

    • ScalableMNN

      Public
      Official Repository for "Scalable Mechanistic Neural Networks" (ICLR 2025)
      Python
      •
      MIT License
      •0•2•0•0•Updated Feb 19, 2025Feb 19, 2025

    • SPADE

      Public
      Code of SPADE: Sparsity Guided Debugging for Deep Neural Networks
      Jupyter Notebook
      •3•1•1•0•Updated Feb 18, 2025Feb 18, 2025

    • HALO

      Public
      HALO: Hadamard-Assisted Low-Precision Optimization and Training method for finetuning LLMs. 🚀 The official implementation of https://arxiv.org/abs/2501.02625
      Python
      •
      MIT License
      •0•18•1•0•Updated Feb 17, 2025Feb 17, 2025

    • gemm-fp8

      Public
      High Performance FP8 GEMM Kernels for SM89 and later GPUs.
      Cuda
      •
      MIT License
      •1•16•0•0•Updated Jan 24, 2025Jan 24, 2025

    • GridSearcher

      Public
      GridSearcher simplifies running grid searches for machine learning projects in Python, emphasizing parallel execution and GPU scheduling without dependencies on SLURM or other workload managers.
      Python
      •
      Apache License 2.0
      •0•2•0•0•Updated Jan 23, 2025Jan 23, 2025

    • MicroAdam

      Public
      This repository contains code for the MicroAdam paper.
      Python
      •
      Apache License 2.0
      •4•19•1•0•Updated Dec 14, 2024Dec 14, 2024

    • llm-foundry

      Public
      LLM training code for Databricks foundation models
      Python
      •
      Apache License 2.0
      •575•0•0•1•Updated Nov 27, 2024Nov 27, 2024

    • marlin_artifact

      Public
      Python
      •0•2•0•0•Updated Nov 25, 2024Nov 25, 2024

    • LDAdam-anonymous

      Public
      0•0•0•0•Updated Nov 20, 2024Nov 20, 2024

    • LDAdam

      Public
      LDAdam - Adaptive Optimization from Low-Dimensional Gradient Statistics
      Python
      •
      Apache License 2.0
      •1•7•0•0•Updated Nov 6, 2024Nov 6, 2024

    • Sparse-Marlin

      Public
      Boosting 4-bit inference kernels with 2:4 Sparsity
      Cuda
      •
      Apache License 2.0
      •5•80•1•1•Updated Sep 4, 2024Sep 4, 2024

    • marlin

      Public
      FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
      kernelquantization4bitllm
      Python
      •
      Apache License 2.0
      •72•873•29•5•Updated Sep 4, 2024Sep 4, 2024

    • sparsegpt

      Public
      Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".
      Python
      •
      Apache License 2.0
      •109•822•18•0•Updated Aug 20, 2024Aug 20, 2024

    • peft-rosa

      Public
      A fork of the PEFT library, supporting Robust Adaptation (RoSA)
      Python
      •
      Apache License 2.0
      •3•14•1•0•Updated Aug 16, 2024Aug 16, 2024

    • AutoGPTQRoSA

      Public
      Python
      •
      MIT License
      •0•0•0•0•Updated Jun 27, 2024Jun 27, 2024

    • spops

      Public
      C++
      •
      Apache License 2.0
      •0•8•2•0•Updated Jun 20, 2024Jun 20, 2024