Tri Dao 898dd4bbf2 Pass seqused_k to _flash_attn_varlen_forward il y a 5 mois
..
layers 3566596ad8 Fix typo in RotaryEmbedding forward output type (#666) il y a 1 an
losses ec6d22143b [CrossEntropy] Change ignored_index -> ignore_index il y a 7 mois
models 0d810cfb73 Fix KeyError handling for non-existing key in state_dict.pop() (#898) il y a 5 mois
modules 6bbc532388 fix: cast the alibi slopes to torch.float32 (#846) il y a 9 mois
ops 22339db185 remove an unused import (#960) il y a 6 mois
utils 320fb59487 Update citation il y a 6 mois
__init__.py 7551202cb2 Bump to v2.6.1 il y a 5 mois
bert_padding.py c94cd09744 Updated missing docstrings for args and returns in bert_padding.py (#795) il y a 10 mois
flash_attn_interface.py 898dd4bbf2 Pass seqused_k to _flash_attn_varlen_forward il y a 5 mois
flash_attn_triton.py f1a73d0740 Run isort and black on python files il y a 1 an
flash_attn_triton_og.py f1a73d0740 Run isort and black on python files il y a 1 an
flash_blocksparse_attention.py f1a73d0740 Run isort and black on python files il y a 1 an
flash_blocksparse_attn_interface.py f1a73d0740 Run isort and black on python files il y a 1 an
fused_softmax.py f1a73d0740 Run isort and black on python files il y a 1 an
pyproject.toml 73bd3f3bbb Move pyproject.toml to flash-attn and tests dir to avoid PEP 517 il y a 1 an