| .. |
|
layers
|
0e8c46ae08
Run isort and black on test files
|
1 year ago |
|
losses
|
d8aacc510c
return z_loss (#768)
|
10 months ago |
|
models
|
73df3be7d5
Add test for BTLM init
|
11 months ago |
|
modules
|
0e8c46ae08
Run isort and black on test files
|
1 year ago |
|
ops
|
f5b308e258
[LayerNorm] Rename layernorm.py -> layer_norm.py
|
11 months ago |
|
pyproject.toml
|
73bd3f3bbb
Move pyproject.toml to flash-attn and tests dir to avoid PEP 517
|
1 year ago |
|
test_flash_attn.py
|
40e534a7f6
Implement cache_leftpad
|
5 months ago |
|
test_rotary.py
|
f692b98d80
Fix spurious re-compilations of `rotary_kernel` (#911)
|
8 months ago |
Tri Dao
40e534a7f6
Implement cache_leftpad