Home Explore Help
Register Sign In
david
/
flash-attention
mirror of https://github.com/Dao-AILab/flash-attention
1
0
Fork 0
Files Issues 0 Wiki
Tree: 0dfb281743
Branches Tags
flash-attention
/
training
/
configs
/
model
/
gpt2model
/
gpt2-xlarge.yaml

gpt2-xlarge.yaml 85 B
History Raw

123456 
  1. # @package _global_
    2. 

  2. model:
    3. 

  3.   config:
    4. 

  4.     n_embd: 1600
    5. 

  5.     n_head: 25
    6. 

  6.     n_layer: 48
    7.