Home Explore Help
Register Sign In
david
/
flash-attention
mirror of https://github.com/Dao-AILab/flash-attention
1
0
Fork 0
Files Issues 0 Wiki
Tree: 9b6cba16c1
Branches Tags
flash-attention
/
training
/
configs
/
model
/
gpt2model
/
gpt2-small.yaml

gpt2-small.yaml 84 B
History Raw

123456 
  1. # @package _global_
    2. 

  2. model:
    3. 

  3.   config:
    4. 

  4.     n_embd: 768
    5. 

  5.     n_head: 12
    6. 

  6.     n_layer: 12
    7.