Home Explore Help
Register Sign In
david
/
flash-attention
mirror of https://github.com/Dao-AILab/flash-attention
1
0
Fork 0
Files Issues 0 Wiki
Branch: main
Branches Tags
flash-attention
/
examples
/
inference
/
README.md

README.md 115 B
Permalink History Raw

Example of LLM inference using FlashAttention

Example script of using FlashAttention for inference coming soon.