 AlpinDale
|
d8f9f0ec16
fix: prefix prefill kernels for fp32 data type
|
vor 5 Monaten |
|
AlpinDale
|
cda0e93a10
abstract away the platform for device capability
|
vor 5 Monaten |
|
AlpinDale
|
7d79c0e726
chore: use nvml query to avoid accidental cuda initialization
|
vor 5 Monaten |
|
AlpinDale
|
f40b809d3b
allow using v2 block manager with sliding window
|
vor 6 Monaten |
|
AlpinDale
|
c3065aefaf
non-power-of-2 for prefix prefill with alibi
|
vor 6 Monaten |
|
AlpinDale
|
aa15d3dc0f
sliding window in prefix prefill kernel
|
vor 6 Monaten |
 AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
vor 7 Monaten |
|
AlpinDale
|
66b7bc4415
sliding window in prefix kernel
|
vor 8 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
