# optimizer

**Repository Path**: summer_wofe/optimizer

## Basic Information

- **Project Name**: optimizer
- **Description**: No description available
- **Primary Language**: Unknown
- **License**: MIT
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2026-07-23
- **Last Updated**: 2026-07-23

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

## Contains implementations of Muon & MuonAll optimizer

pip install git+https://github.com/Saurabh750/optimizer

## To use Muon optimizer:
from muon import Muon

optimizer = Muon(model.named_parameters(), lr=MUON_LEARNING_RATE, adamw_lr=ADAMW_LEARNING_RATE)

## To use MuonAll optimizer:
from muon import MuonAll

optimizer = MuonAll(model.named_parameters(), lr=MUON_LEARNING_RATE)