| .. |
|
layers
|
0e8c46ae08
Run isort and black on test files
|
1 rok pred |
|
losses
|
d8aacc510c
return z_loss (#768)
|
1 rok pred |
|
models
|
73df3be7d5
Add test for BTLM init
|
1 rok pred |
|
modules
|
0e8c46ae08
Run isort and black on test files
|
1 rok pred |
|
ops
|
f5b308e258
[LayerNorm] Rename layernorm.py -> layer_norm.py
|
1 rok pred |
|
pyproject.toml
|
73bd3f3bbb
Move pyproject.toml to flash-attn and tests dir to avoid PEP 517
|
1 rok pred |
|
test_flash_attn.py
|
299563626f
Fix test with alibi and cache_leftpad
|
6 mesiacov pred |
|
test_flash_attn_ck.py
|
d8f104e97a
Support AMD ROCm on FlashAttention 2 (#1010)
|
6 mesiacov pred |
|
test_rotary.py
|
f692b98d80
Fix spurious re-compilations of `rotary_kernel` (#911)
|
9 mesiacov pred |
|
test_util.py
|
496fdc4f6c
Add seqused_q in fwd / bwd and seqused_k in bwd.
|
4 mesiacov pred |
Ying Zhang
496fdc4f6c
Add seqused_q in fwd / bwd and seqused_k in bwd.