This is a collection of simple PyTorch implementation of various neural network architectures and layers. We will keep adding to this.

Transformers module contains implementations for multi-headed attention and relative multi-headed attention.

This is the implementation for Recurrent Highway Networks.

This is the implementation for LSTMs.

✅ Please create a Github issue if there's something you'ld like to see implemented here.

pip install labml_nn

💬 Slack workspace for discussions

📗 Documentation

📑 Articles & Tutorials

👨‍🏫 Samples

If you use LabML for academic research, please cite the library using the following BibTeX entry.

@misc{labml,
 author = {Varuna Jayasiri, Nipun Wijerathne},
 title = {LabML: A library to organize machine learning experiments},
 year = {2020},
 url = {https://lab-ml.com/},
}