Home Explore Help
Register Sign In
david
/
flash-attention
mirror of https://github.com/Dao-AILab/flash-attention
1
0
Fork 0
Files Issues 0 Wiki
Tree: d5893f3c74
Branches Tags
flash-attention
/
flash_attn
/
modules
Markus Krimmel 6bbc532388 fix: cast the alibi slopes to torch.float32 (#846) 9 months ago
..
__init__.py ece539abd6 Add __init__.py files to subdirectories for installation 2 years ago
block.py abbc131173 [LayerNorm] Switch from CUDA to Triton implementation 11 months ago
embedding.py f1a73d0740 Run isort and black on python files 1 year ago
mha.py 6bbc532388 fix: cast the alibi slopes to torch.float32 (#846) 9 months ago
mlp.py c3b2196652 Add Alibi to MHA, test with Baichuan-13B 1 year ago