 Tri Dao
|
bcd918f275
[LayerNorm] Add option to write result to out and residual_out
|
vor 4 Monaten |
|
Tri Dao
|
bd82d6c6eb
Revert "[LayerNorm] Don't store x + residual if we don't need gradients"
|
vor 4 Monaten |
|
Tri Dao
|
800401847e
[LayerNorm] Don't store x + residual if we don't need gradients
|
vor 4 Monaten |
|
Tri Dao
|
36587c01cb
[LayerNorm] Update layer_norm_linear
|
vor 9 Monaten |
|
Tri Dao
|
bdcae547c7
[LayerNorm] Don't exit early in the backward pass (fix #781)
|
vor 10 Monaten |
|
Tri Dao
|
c9861a032d
[LayerNorm] Initialize mean and rstd tensor using x.device
|
vor 11 Monaten |
|
Tri Dao
|
f5b308e258
[LayerNorm] Rename layernorm.py -> layer_norm.py
|
vor 11 Monaten |
