diff options
Diffstat (limited to 'CHANGELOG.md')
| -rw-r--r-- | CHANGELOG.md | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/CHANGELOG.md b/CHANGELOG.md index 683f437..d12af22 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -38,3 +38,12 @@ Docs: - Added docs with instructions to compile from source. +### 0.26.0: + +Features: + - Added Adagrad (without grad clipping) as 32-bit and 8-bit block-wise optimizer. + - Added AdamW (copy of Adam with weight decay init 1e-2). #10 + +Bug fixes: + - Fixed a bug where weight decay was incorrectly applied to 32-bit Adam. #13 + - Fixed an unsafe use of eval. #8 |