Commit History

Автор SHA1 Съобщение Дата
  Tri Dao f86e3dd919 [CI] Use MAX_JOBS=1 with nvcc 12.3, don't need OLD_GENERATOR_PATH преди 1 седмица
  Tri Dao 9375ac9322 [CI] Don't include <ATen/cuda/CUDAGraphsUtils.cuh> преди 1 седмица
  Tri Dao 073afd5931 [CI] Use torch 2.6.0.dev20241001, reduce torch #include преди 1 седмица
  Michael Melesse b518517cb8 [AMD] Triton Backend for ROCm (#1203) преди 1 седмица
  Tri Dao 241c682c9f [CI] Switch back to CUDA 12.4 преди 1 месец
  Tri Dao 6ffeb572b1 [CI] Still use CUDA 12.3 but pull the right pytorch version преди 1 месец
  Ethan Steinberg 42f2b8be34 Use CUDA 12.4 in the build system (#1326) преди 1 месец
  rocking e2182cc21d Support page kvcache in AMD ROCm (#1198) преди 3 месеца
  juejuezi e371bea04f feat: change minimal supported CUDA version to 11.7 (#1206) преди 3 месеца
  Tri Dao 65f723bb9a Split bwd into more .cu files to speed up compilation преди 4 месеца
  Tri Dao 751c762c9c Don't specialize for hdim 224 to speed up compilation преди 4 месеца
  rocking d8f104e97a Support AMD ROCm on FlashAttention 2 (#1010) преди 4 месеца
  Tri Dao 844912dca0 [CI] Switch from CUDA 12.2 to 12.3 преди 5 месеца
  Tri Dao 908511b2b6 Split into more .cu files to speed up compilation преди 5 месеца
  Tri Dao beb2bf2a32 Drop support for pytorch 1.12, 1.13, and python 3.7 преди 5 месеца
  Nicolas Patry 8f873cc6ac Implement softcapping. (#1025) преди 5 месеца
  Corey James Levinson beb8b8ba9f add exception to Timeout Error (#963) преди 6 месеца
  Wei Ji 9c0e9ee86d Move packaging and ninja from install_requires to setup_requires (#937) преди 7 месеца
  Tri Dao 2aea958f89 [CI] Compile with torch 2.3.0.dev20240207 преди 8 месеца
  Arvind Sundararajan 26c9e82743 Support ARM builds (#757) преди 9 месеца
  Chirag Jain 50896ec574 Make nvcc threads configurable via environment variable (#885) преди 9 месеца
  Qubitium f45bbb4c94 Optimize compile to 1: avoid oom 2: minimize swap usage 3: avoid threads starvation when letting ninja decide how many workers to spawn or manual MAX_JOBS "guesses". Logic is to take the min value of MAX_JOBS auto-calculated by two metrics: 1: cpu cores 2: free memory. This should allow flash-attn to compile close to the most efficient manner under any consumer/server env. (#832) преди 10 месеца
  Tri Dao d4a7c8ffbb [CI] Only compile for CUDA 11.8 & 12.2, MAX_JOBS=2,add torch-nightly преди 1 година
  Tri Dao 5e525a8dc8 [CI] Use official Pytorch 2.1, add CUDA 11.8 for Pytorch 2.1 преди 1 година
  Tri Dao 1879e089c7 Reduce number of templates for headdim > 128 преди 1 година
  Tri Dao bff3147175 Re-enable compilation for Hopper преди 1 година
  Tri Dao dfe29f5e2b [Gen] Don't use ft_attention, use flash_attn_with_kvcache instead преди 1 година
  Federico Berto fa3ddcbaaa [Minor] add nvcc note on bare_metal_version `RuntimeError` (#552) преди 1 година
  Tri Dao 799f56fa90 Don't compile for Pytorch 2.1 on CUDA 12.1 due to nvcc segfaults преди 1 година
  Tri Dao bb9beb3645 Remove some unused headers преди 1 година