 AlpinDale
|
614ca6b0bf
feat: support logits soft capping with flash attention backend
|
vor 4 Monaten |
|
AlpinDale
|
6b1fdd07bd
chore: add isort and refactor formatting script and utils
|
vor 4 Monaten |
|
AlpinDale
|
22305c91e9
refactor _prepare_model_input_tensor and attn metadata builder for most backends
|
vor 5 Monaten |
|
AlpinDale
|
9d7beaa5b9
chore: separate kv_scale into k_scale and v_scale
|
vor 5 Monaten |
|
AlpinDale
|
2105e4fd6b
feat: correctly invoke prefill & decode kernels for cross-attention
|
vor 5 Monaten |
 AlpinDale
|
405bb74612
Control plane comms refactor (#573)
|
vor 5 Monaten |
|
AlpinDale
|
6a57861fca
feat: initial XPU support via intel_extension_for_pytorch (#571)
|
vor 5 Monaten |
