Chirag Jain
50896ec574
Make nvcc threads configurable via environment variable (#885)
|
преди 9 месеца | |
|---|---|---|
| .. | ||
| README.md | преди 2 години | |
| fused_dense.cpp | преди 1 година | |
| fused_dense_cuda.cu | преди 1 година | |
| setup.py | преди 9 месеца | |
README.md
This CUDA extension implements fused matmul + bias (forward and backward), and fused matmul + bias + gelu (forward and backward), adapted from Apex's FusedDense. We make it work for bfloat16.
For best performance, you should use CUDA >= 11.8. CuBLAS versions before this doesn't have the best matmul + bias + gelu performance for bfloat16.
It has only been tested on A100s.
cd csrc/fused_dense_lib && pip install .