Code for BLT research paper

Interactive deep learning book with multi-framework code, math, and discussions. Adopted at 500 universities from 70 countries including Stanford, MIT, Harvard, and Cambridge.

Normalized Transformer (nGPT)

NanoGPT (124M) in 3 minutes

Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI

21 Lessons, Get Started Building with Generative AI

Video+code lecture on building nanoGPT from scratch

A pure NumPy implementation of Mamba.

llama3 implementation one matrix multiplication at a time

Resources about xLSTM by Sepp Hochreiter

Code for 'LLM2Vec: Large Language Models Are Secretly Powerful Text Encoders'

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

FinGPT: Open-Source Financial Large Language Models! Revolutionize 🔥 We release the trained model on HuggingFace.

Code for the book Deep Learning with PyTorch by Eli Stevens, Luca Antiga, and Thomas Viehmann.

Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI.

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.