david/aphrodite-engine

Mirror von https://github.com/PygmalionAI/aphrodite-engine

Autor	SHA1 Nachricht	Datum
AlpinDale	a98babfb74 fix: bnb on Turing GPUs (#299)	vor 10 Monaten
AlpinDale	49793d7c5a fix: bump bnb kernels to sm_80 due to async stream copies	vor 10 Monaten
AlpinDale	82955ba440 fix: backport bnb kernels (#297)	vor 10 Monaten
AlpinDale	e0c35bb353 feat: bitsandbytes and `--load-in{4,8}bit` support (#294)	vor 10 Monaten