david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 696f2cd59c3bfe4cd83be719a8e97c7b2ab73ac2

AlpinDale 696f2cd59c add phi3_small support with blocksparse attention		7 meses atrás
..
backends	696f2cd59c add phi3_small support with blocksparse attention	7 meses atrás
ops	696f2cd59c add phi3_small support with blocksparse attention	7 meses atrás
__init__.py	a94de94c44 refactor: combine the prefill and decode into a single API (#553)	7 meses atrás
layer.py	696f2cd59c add phi3_small support with blocksparse attention	7 meses atrás
selector.py	696f2cd59c add phi3_small support with blocksparse attention	7 meses atrás