 AlpinDale
|
22425a03f8
guard against using block manager v1
|
vor 1 Monat |
|
AlpinDale
|
22425c186b
formatting
|
vor 1 Monat |
|
AlpinDale
|
2242cf6fc5
clean-up and example script
|
vor 1 Monat |
|
AlpinDale
|
2242975cfc
fix
|
vor 1 Monat |
|
AlpinDale
|
2242c38a30
feat: classifier free guidance - take 2
|
vor 1 Monat |
 AlpinDale
|
60f7b828d5
feat: add skew sampling (#834)
|
vor 1 Monat |
|
AlpinDale
|
ba9d8f631a
feat: add no_repeat_ngram sampler (#832)
|
vor 2 Monaten |
 Selali
|
4c4a365f77
feat: Add DRY (Don't Repeat Yourself) sampling (#827)
|
vor 2 Monaten |
|
AlpinDale
|
48a8693aed
feat: multi-step scheduling (#831)
|
vor 2 Monaten |
|
AlpinDale
|
2242cb25dc
fix: unbound tokenizer error
|
vor 2 Monaten |
|
AlpinDale
|
3d83e64f8e
feat: add metrics for prefix cache hit rate (#829)
|
vor 2 Monaten |
|
AlpinDale
|
22425b689d
fix: XPU build
|
vor 2 Monaten |
|
AlpinDale
|
bfc8988116
feat: add cuda sampling kernels for top_k and top_p (#828)
|
vor 2 Monaten |
|
AlpinDale
|
22427602eb
feat: add top-nsigma sampling method
|
vor 2 Monaten |
|
AlpinDale
|
22429e4a10
fix: sampler test with new transformers version
|
vor 2 Monaten |
|
AlpinDale
|
2f61644f6e
SPMD optimizations (#824)
|
vor 2 Monaten |
|
AlpinDale
|
32a37e8107
tests: partially fix tensorizer and logprobs tests
|
vor 2 Monaten |
|
AlpinDale
|
7f1c9af5e2
fix: fp8 quant test
|
vor 2 Monaten |
|
AlpinDale
|
173ac23399
fix: experts int8 quant test
|
vor 2 Monaten |
|
AlpinDale
|
68f050129d
fix: lora worker manager test import
|
vor 2 Monaten |
|
AlpinDale
|
3661de812d
fix: lora layer test
|
vor 2 Monaten |
|
AlpinDale
|
0a369f9171
feat: support chunked prefill with LoRA (#823)
|
vor 2 Monaten |
|
AlpinDale
|
e5b1afe625
feat: add chat method for LLM class (#822)
|
vor 2 Monaten |
|
AlpinDale
|
262cbc63b7
fix: vision api test template path
|
vor 2 Monaten |
|
AlpinDale
|
b0113a1eaa
fix: tokenization api test (#821)
|
vor 2 Monaten |
|
AlpinDale
|
c6c91edab7
ci: update & overhaul test units (#769)
|
vor 2 Monaten |
|
AlpinDale
|
f088ea81c7
fix: --max-seq-len-to-capture arg (#818)
|
vor 2 Monaten |
 50h100a
|
a5346b2ea5
Merge pull request #814 from PygmalionAI/50h100a-temp-fix
|
vor 2 Monaten |
|
50h100a
|
273c61d406
guard against nan temperature from dynatemp (or anywhere else).
|
vor 2 Monaten |
|
50h100a
|
a22e887319
why we don't use the github website editor to make changes
|
vor 2 Monaten |
