| .. |
|
__init__.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hace 10 meses |
|
abstract.py
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
hace 2 meses |
|
blocksparse_attn.py
|
1405051912
attention: add `AttentionState` abstraction (#863)
|
hace 3 meses |
|
flash_attn.py
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
hace 2 meses |
|
flashinfer.py
|
c951a54d21
fix: multi-step + flashinfer with cuda graphs (#1036)
|
hace 2 meses |
|
ipex_attn.py
|
6951928522
xpu: bump IPEX to 2.3, support GQA (#1042)
|
hace 2 meses |
|
openvino.py
|
1405051912
attention: add `AttentionState` abstraction (#863)
|
hace 3 meses |
|
pallas.py
|
032974a28a
tpu: fix TPU type api (#975)
|
hace 2 meses |
|
placeholder_attn.py
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
hace 2 meses |
|
rocm_flash_attn.py
|
4a7cb8f232
rocm: add custom paged attention kernels for ROCm (#1043)
|
hace 2 meses |
|
torch_sdpa.py
|
1405051912
attention: add `AttentionState` abstraction (#863)
|
hace 3 meses |
|
utils.py
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
hace 2 meses |
|
xformers.py
|
1405051912
attention: add `AttentionState` abstraction (#863)
|
hace 3 meses |
AlpinDale
4a7cb8f232
rocm: add custom paged attention kernels for ROCm (#1043)