david/flash-attention: flash-attention from https://github.com/Dao-AILab/flash-attention @ 4ead9bd7cc60e7b8b33c3af6b0b801488119f941

Markus Krimmel 6bbc532388 fix: cast the alibi slopes to torch.float32 (#846)		10 ماه پیش
..
__init__.py	ece539abd6 Add __init__.py files to subdirectories for installation	2 سال پیش
block.py	abbc131173 [LayerNorm] Switch from CUDA to Triton implementation	1 سال پیش
embedding.py	f1a73d0740 Run isort and black on python files	1 سال پیش
mha.py	6bbc532388 fix: cast the alibi slopes to torch.float32 (#846)	10 ماه پیش
mlp.py	c3b2196652 Add Alibi to MHA, test with Baichuan-13B	1 سال پیش