| .. |
|
__init__.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
|
abstract.py
|
a985143768
core: add cuda graph support for encoder-decoder models (#1051)
|
1 week ago |
|
blocksparse_attn.py
|
1405051912
attention: add `AttentionState` abstraction (#863)
|
1 month ago |
|
flash_attn.py
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
1 week ago |
|
flashinfer.py
|
a985143768
core: add cuda graph support for encoder-decoder models (#1051)
|
1 week ago |
|
ipex_attn.py
|
6951928522
xpu: bump IPEX to 2.3, support GQA (#1042)
|
1 week ago |
|
openvino.py
|
1405051912
attention: add `AttentionState` abstraction (#863)
|
1 month ago |
|
pallas.py
|
032974a28a
tpu: fix TPU type api (#975)
|
2 weeks ago |
|
placeholder_attn.py
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
2 weeks ago |
|
rocm_flash_attn.py
|
d9d287a288
rocm: enable multi-step scheduling for rocm (#1071)
|
5 days ago |
|
torch_sdpa.py
|
1405051912
attention: add `AttentionState` abstraction (#863)
|
1 month ago |
|
utils.py
|
a985143768
core: add cuda graph support for encoder-decoder models (#1051)
|
1 week ago |
|
xformers.py
|
1405051912
attention: add `AttentionState` abstraction (#863)
|
1 month ago |
AlpinDale
d9d287a288
rocm: enable multi-step scheduling for rocm (#1071)