Skip to content

Commit 2748b92

Browse files
szagoruykosoumith
authored andcommitted
make adam have the same lr as lua torch (pytorch#576)
1 parent a92a231 commit 2748b92

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

torch/optim/adam.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -20,7 +20,7 @@ class Adam(Optimizer):
2020
https://arxiv.org/abs/1412.6980
2121
"""
2222

23-
def __init__(self, params, lr=1e-2, betas=(0.9, 0.999), eps=1e-8,
23+
def __init__(self, params, lr=1e-3, betas=(0.9, 0.999), eps=1e-8,
2424
weight_decay=0):
2525
defaults = dict(lr=lr, betas=betas, eps=eps,
2626
weight_decay=weight_decay)

0 commit comments

Comments
 (0)