david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ ee174ea4fd3bda4f206c74e0c3f53d978fb10475

AlpinDale 8c32e49029 feat: add avx2 cpu support		7 months ago
..
activation.cpp	9d81716bfd [v0.5.3] Release Candidate (#388)	10 months ago
attention.cpp	156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)	7 months ago
cache.cpp	156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)	7 months ago
cpu_types.hpp	8c32e49029 feat: add avx2 cpu support	7 months ago
layernorm.cpp	156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)	7 months ago
pos_encoding.cpp	156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)	7 months ago
torch_bindings.cpp	156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)	7 months ago