diff options
| author | Tim Dettmers <dettmers@g3030.hyak.local> | 2021-10-21 16:07:24 -0700 |
|---|---|---|
| committer | Tim Dettmers <dettmers@g3030.hyak.local> | 2021-10-21 16:07:24 -0700 |
| commit | d2f16726905f53952fc744147802076f6a1d8711 (patch) | |
| tree | ee1a92ad4ffff4704c4b1d7701b435294629e675 | |
| parent | 0c5fa5a6372b60bac4bdb953dfe8cc4d4e88bd61 (diff) | |
Added changes for analysis Adam.
| -rw-r--r-- | CHANGELOG.md | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/CHANGELOG.md b/CHANGELOG.md index 0d3a379..01fb3af 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -28,6 +28,7 @@ Features: Features: - Added `skip_zeros` for block-wise and 32-bit optimizers. This ensures correct updates for sparse gradients and sparse models. - Added support for Kepler GPUs. (#4) + - Added Analysis Adam to track 8-bit vs 32-bit quantization errors over time. Bug fixes: - fixed "undefined symbol: \_\_fatbinwrap_38" error for P100 GPUs on CUDA 10.1 (#5) |