Cogito v2 is the large language model developed by DeepCogito team

PyTorch native post-training library

PyTorch code and models for VJEPA2 self-supervised learning from video.

Load compute kernels from the Hub

Recipes to train reward model for RLHF.

Implementation of 💍 Ring Attention, from Liu et al. at Berkeley AI, in Pytorch

An extremely fast Python package and project manager, written in Rust.

Ongoing research training transformer models at scale

Puzzles for learning Triton

Implementation of a Transformer, but completely in Triton

Flops counter for neural networks in pytorch framework

The repository provides code for running inference with the SegmentAnything Model (SAM), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

Helpful tools and examples for working with flex-attention

Minimalistic large language model 3D-parallelism training

A library for efficient similarity search and clustering of dense vectors.

Perf monitoring CLI tool for Apple Silicon

Parallel computing with task scheduling

Extremely fast Query Engine for DataFrames, written in Rust

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

A Data Streaming Library for Efficient Neural Network Training

Fast Inference Solutions for BLOOM

DataComp: In search of the next generation of multimodal datasets

This project shows how to serve an ONNX-optimized image classification model as a web service with FastAPI, Docker, and Kubernetes.

An open-source framework for training large multimodal models.

Code and documentation to train Stanford's Alpaca models, and generate the data.

Instruct-tune LLaMA on consumer hardware

GPU Programming @ IIT Madras

GSoC'2021 | TensorFlow implementation of Wav2Vec2