david/aphrodite-engine

réplica de https://github.com/PygmalionAI/aphrodite-engine

Autor	SHA1 Mensaxe	Data
AlpinDale	a98babfb74 fix: bnb on Turing GPUs (#299)	hai 11 meses
AlpinDale	49793d7c5a fix: bump bnb kernels to sm_80 due to async stream copies	hai 11 meses
AlpinDale	82955ba440 fix: backport bnb kernels (#297)	hai 11 meses
AlpinDale	e0c35bb353 feat: bitsandbytes and `--load-in{4,8}bit` support (#294)	hai 11 meses