Implementation of LION gradient optimizer.
-
Updated
Aug 15, 2025 - Python
#
lion-optimizer
Here are 3 public repositories matching this topic...
Homemade Copilot: Fine-tune LLM through LoftQ initialization and QLoRA-style training for code generation.
pytorch huggingface-transformers huggingface-accelerate huggingface-datasets huggingface-peft gradiio 8bit-optimizer lion-optimizer paged-optimizer
-
Updated
Feb 5, 2024 - Jupyter Notebook
Super-Convergence on CIFAR10
sophia cifar10 lion second-order-optimization adamw super-convergence weight-decay sharpness-aware-minimization madgrad large-batch-optimization lion-optimizer
-
Updated
Jun 17, 2024 - Python
Improve this page
Add a description, image, and links to the lion-optimizer topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the lion-optimizer topic, visit your repo's landing page and select "manage topics."