# AdaNorm

**Repository Path**: hazdzz/AdaNorm

## Basic Information

- **Project Name**: AdaNorm
- **Description**: The PyTorch implementation of AdaNorm.
- **Primary Language**: Python
- **License**: MIT
- **Default Branch**: main
- **Homepage**: None
- **GVP Project**: No

## Statistics

- **Stars**: 0
- **Forks**: 0
- **Created**: 2024-05-23
- **Last Updated**: 2024-06-29

## Categories & Tags

**Categories**: Uncategorized

**Tags**: None

## README

# AdaNorm

## About
The PyTorch implementation of AdaNorm from the paper *Understanding and Improving Layer Normalization*.

## Paper
https://arxiv.org/abs/1911.07013

## Citation
```
@inproceedings{NEURIPS2019_2f4fe03d,
  title     = {Understanding and Improving Layer Normalization},
  author    = {Xu, Jingjing and Sun, Xu and Zhang, Zhiyuan and Zhao, Guangxiang and Lin, Junyang},
  booktitle = {Advances in Neural Information Processing Systems},
  editor    = {H. Wallach and H. Larochelle and A. Beygelzimer and F. d\textquotesingle Alch{\'{e}}-Buc and E. Fox and R. Garnett},
  pages     = {4383--4393},
  publisher = {Curran Associates, Inc.},
  volume    = {32},
  year      = {2019}
}
```