AI-Hypercomputer

All

20 repositories

maxtext
Public
A simple, performant and scalable Jax LLM!
gpt mistral fine-tuning jax sft large-language-models llm llama2 mixtral deepseek
Python
•
Apache License 2.0
•393•1.8k•55•253•Updated Jul 31, 2025Jul 31, 2025
torchprime
Public
torchprime is a reference model implementation for PyTorch on TPU.
Python
•
Other
•7•33•86•10•Updated Jul 31, 2025Jul 31, 2025
maxdiffusion
Public
Python
•
Apache License 2.0
•39•237•7•16•Updated Jul 31, 2025Jul 31, 2025
xpk
Public
xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.
gke gcloud tpu
Python
•
Apache License 2.0
•45•134•19•35•Updated Jul 30, 2025Jul 30, 2025
RecML
Public
Python
•
Apache License 2.0
•16•186•3•16•Updated Jul 30, 2025Jul 30, 2025
pathways-utils
Public
Package of Pathways-on-Cloud utilities
Python
•
Apache License 2.0
•4•16•0•3•Updated Jul 30, 2025Jul 30, 2025
ml-goodput-measurement
Public
Python
•
Apache License 2.0
•2•18•1•0•Updated Jul 29, 2025Jul 29, 2025
cloud-accelerator-diagnostics
Public
Python
•
Apache License 2.0
•10•22•3•0•Updated Jul 25, 2025Jul 25, 2025
cloud-diagnostics-xprof
Public
Python
•
Apache License 2.0
•1•8•0•0•Updated Jul 24, 2025Jul 24, 2025
tpu-recipes
Public
Shell
•
Apache License 2.0
•18•39•3•7•Updated Jul 18, 2025Jul 18, 2025
gpu-recipes
Public
Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
gpu benchmarks google-cloud-platform serving distributed-training
Python
•
Apache License 2.0
•30•77•4•4•Updated Jul 15, 2025Jul 15, 2025
resiliency
Public
This project provides resilient training logic to improve the training efficiency of large-scale distributed workloads on Google Cloud.
Python
•
Apache License 2.0
•0•4•0•0•Updated Jun 26, 2025Jun 26, 2025
inference-benchmark
Public
Python
•
Apache License 2.0
•12•10•7•4•Updated Jun 18, 2025Jun 18, 2025
JetStream
Public
JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs welcome).
gpu inference pytorch transformer llama gpt gemma model-serving tpu jax
Python
•
Apache License 2.0
•49•364•13•12•Updated Jun 10, 2025Jun 10, 2025
accelerator-microbenchmarks
Public
Python
•
Apache License 2.0
•4•2•0•0•Updated Jun 2, 2025Jun 2, 2025
kithara
Public
Python
•
Apache License 2.0
•6•14•0•2•Updated May 19, 2025May 19, 2025
ray-tpu
Public
Python
•
Apache License 2.0
•4•13•3•0•Updated May 11, 2025May 11, 2025
aotc
Public
Python
•
Other
•0•0•0•0•Updated May 8, 2025May 8, 2025
jetstream-pytorch
Public
PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
inference pytorch batching attention llama gemma model-serving tpu llm llm-inference
Python
•
Apache License 2.0
•18•66•10•4•Updated Mar 27, 2025Mar 27, 2025
cloud-tpu-monitoring-debugging
Public
HCL
•
Apache License 2.0
•1•12•0•0•Updated Feb 18, 2025Feb 18, 2025