An experiment implementing the decoder part of the transformer architecture from the paper "Attention is All You Need" by Vaswani et al. (2017) in PyTorch.
The current model was trained on TinyStories Dataset.
This project is a work in progress.
-
Notifications
You must be signed in to change notification settings - Fork 0
rakeshbs/tiny_transformer
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Experimenting with implementing transformers from scratch.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published