Skip to content
Change the repository type filter

All

    Repositories list

    • From Images to High-Fidelity 3D Assets with Production-Ready PBR Material
      Python
      203000Updated Jul 16, 2025Jul 16, 2025
    • oneCCL

      Public
      oneAPI Collective Communications Library (oneCCL)
      C++
      83100Updated May 27, 2025May 27, 2025
    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      9.1k7013Updated May 12, 2025May 12, 2025
    • sglang

      Public
      SGLang is a fast serving framework for large language models and vision language models.
      Python
      2.5k000Updated Apr 16, 2025Apr 16, 2025
    • llmperf

      Public
      LLMPerf is a library for validating and benchmarking LLMs
      Python
      181000Updated Mar 17, 2025Mar 17, 2025
    • User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
      Svelte
      14k000Updated Nov 6, 2024Nov 6, 2024
    • ipex-llm

      Public
      Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, Baichuan, Mixtral, Gemma, etc.) on Intel CPU and GPU (e.g., local PC with iGPU, discrete GPU such as Arc, Flex and Max). A PyTorch LLM library that seamlessly integrates with llama.cpp, HuggingFace, LangChain, LlamaIndex, DeepSpeed, vLLM, FastChat, ModelScope, etc.
      Python
      1.4k000Updated Aug 24, 2024Aug 24, 2024
    • inference

      Public
      Reference implementations of MLPerf™ inference benchmarks
      Python
      568000Updated Aug 7, 2024Aug 7, 2024
    • Store the benchmark config for vllm
      Shell
      0000Updated Jul 10, 2024Jul 10, 2024
    • DeepSpeed

      Public
      DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
      Python
      4.5k000Updated May 16, 2024May 16, 2024
    • FastChat

      Public
      An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
      Python
      4.7k100Updated May 14, 2024May 14, 2024
    • ollama

      Public
      Get up and running with Llama 2, Mistral, Gemma, and other large language models.
      C++
      13k000Updated Mar 19, 2024Mar 19, 2024
    • 🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
      Python
      30k002Updated Dec 12, 2023Dec 12, 2023
    • Lua
      3000Updated Nov 15, 2023Nov 15, 2023
    • A framework for few-shot evaluation of autoregressive language models.
      Python
      2.6k010Updated Nov 9, 2023Nov 9, 2023
    • GitHub Action CI/CD environments
      Python
      6000Updated Oct 16, 2023Oct 16, 2023
    • GPTCache

      Public
      Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
      Python
      549000Updated Oct 13, 2023Oct 13, 2023
    • Serve, optimize and scale PyTorch models in production
      Java
      885000Updated Sep 4, 2023Sep 4, 2023
    • gramine

      Public
      A library OS for Linux multi-process applications, with Intel SGX support
      C
      214000Updated Jul 24, 2023Jul 24, 2023
    • C++ implementation for BLOOM
      C
      60000Updated Jul 5, 2023Jul 5, 2023
    • MLServer

      Public
      An inference server for your machine learning models, including support for multiple frameworks, multi-model serving and more
      Python
      204000Updated Jul 4, 2023Jul 4, 2023
    • Main libjpeg-turbo repository
      C
      1.1k000Updated Jun 29, 2023Jun 29, 2023
    • tcmalloc

      Public
      C++
      516000Updated Apr 23, 2023Apr 23, 2023
    • hadoop

      Public
      Apache Hadoop
      Java
      9.1k001Updated Apr 18, 2023Apr 18, 2023
    • LightGBM

      Public
      A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.
      C++
      3.9k100Updated Apr 17, 2023Apr 17, 2023
    • hive

      Public
      Apache Hive
      Java
      4.8k000Updated Apr 4, 2023Apr 4, 2023
    • keywhiz

      Public
      A system for distributing and managing secrets
      Java
      216000Updated Apr 4, 2023Apr 4, 2023
    • zeppelin

      Public
      Web-based notebook that enables data-driven, interactive data analytics and collaborative documents with SQL, Scala and more.
      Java
      2.8k000Updated Feb 15, 2023Feb 15, 2023
    • jemalloc

      Public
      C
      1.5k000Updated Jan 29, 2023Jan 29, 2023
    • kvdi

      Public
      A Kubernetes-native Virtual Desktop Infrastructure
      Go
      48000Updated Nov 29, 2022Nov 29, 2022