Commit History

Autor SHA1 Mensaxe Data
  AlpinDale 9d9722b1c1 fix: metrics endpoint with RPC server (#747) hai 3 meses
  AlpinDale 2d044af0e1 chore: spawn engine process from api server process (#703) hai 4 meses
  AlpinDale 1d3a1fec47 feat: add load/unload endpoints for soft-prompts (#694) hai 4 meses
  AlpinDale c34a6ac8e4 feat: add lora loading/unloading api endpoint (#693) hai 4 meses
  AlpinDale ed9a6f97c1 fix: kill api server when pinging dead engine (#660) hai 4 meses
  AlpinDale 83bcb9119a fix: multiprocessing timeout (#654) hai 4 meses
  AlpinDale a2344d3617 fix: move zeromq rpc frontend to IPC instead of TCP (#652) hai 4 meses
  AlpinDale 59264d32e9 fix: hardcoded float16 in embedding mode check (#645) hai 4 meses
  AlpinDale f1d0b77c92 [0.6.0] Release Candidate (#481) hai 4 meses
  AlpinDale 9d81716bfd [v0.5.3] Release Candidate (#388) hai 8 meses
  Krovius 205c8e4106 fix: kobold api /tokencount (#424) hai 8 meses
  IggoOnCode 2aec297c55 feat: add embeddings endpoint to openai rest-api server. (#363) hai 9 meses
  AlpinDale f8dfac6372 chore: attention refactor and upstream sync apr01 (#365) hai 9 meses
  Absurd 070c1cef8c fix: explicit RFC3986 for prometheus_client asgi (#344) hai 9 meses
  AlpinDale 398a97338a feat: enable lora loading/unloading via API (#337) hai 9 meses
  AlpinDale e42a78381a feat: switch from pylint to ruff (#322) hai 10 meses
  drummerv e59dd4a90d fix: openai gguf chat template (#312) hai 10 meses
  AlpinDale c2d77b1822 chore: logging refactor (#302) hai 10 meses
  Pyroserenus 951077de65 chore: update klite.embd with current version (#296) hai 10 meses
  AlpinDale ac82b67f75 feat: naive context shift and various QoL changes (#289) hai 10 meses
  AlpinDale f35d15e632 fix: arg detection for kobold api launch (#286) hai 10 meses
  AlpinDale 23a7fd8cda remove ooba endpoint, fix and add deprecation warning for kobold endpoint, fix case where kobold endpoint was always launched with openai (#284) hai 10 meses
  AlpinDale 9fa99215f8 feat: add cubic sampling (#280) hai 10 meses
  AlpinDale 657aec0cbd refactor: OpenAI endpoint (#261) hai 10 meses
  AlpinDale 4d04ade9ef feat: fine-grained seeds (#279) hai 10 meses
  swadical 0527131e93 fix: grammar logits processor (#268) hai 10 meses
  AlpinDale d2db4143fa feat: add grafana for metrics (#240) hai 11 meses
  AlpinDale 1c46fa31ad feat: add quadratic sampling (#233) hai 11 meses
  AlpinDale 0adab894fe feat: grammar support (#206) hai 11 meses
  AlpinDale 8fa608aeb7 feat: replace Ray with NCCL for control plane comms (#221) hai 11 meses