 Tri Dao
|
f1a73d0740
Run isort and black on python files
|
hai 1 ano |
|
Tri Dao
|
ff34123bd4
Reorder LN in Block, support OPT
|
%!s(int64=2) %!d(string=hai) anos |
|
Tri Dao
|
93383bd55b
[TP] Implement TensorParallel without sequence parallel
|
%!s(int64=2) %!d(string=hai) anos |
|
Tri Dao
|
4cab4de5ea
[TP] Put parallel embeddings in separate modules
|
%!s(int64=2) %!d(string=hai) anos |
|
Tri Dao
|
78225c5366
Implement Tensor Parallel for GPT2Embeddings
|
%!s(int64=2) %!d(string=hai) anos |
|
Tri Dao
|
5fb6df0e04
Implement BERT
|
%!s(int64=2) %!d(string=hai) anos |
|
Tri Dao
|
d4b320b31f
Add MLP, MHA, Block, Embedding modules
|
%!s(int64=2) %!d(string=hai) anos |
