A native PyTorch Library for large model training

torchcomms: a modern PyTorch communications API

Make PyTorch models up to 40% faster! Thunder is a source to source compiler for PyTorch. It enables using different hardware executors at once; across one or thousands of GPUs.

A Quirky Assortment of CuTe Kernels

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

COCO API - Dataset @ http://cocodataset.org/

Triton-based Symmetric Memory operators and examples

Distributed Compiler based on Triton for Parallel Systems

SGLang is a fast serving framework for large language models and vision language models.

The missing pytorch dtype and layout library for training and inference

Development repository for the Triton language and compiler

A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")

Ongoing research training transformer models at scale

Models, data loaders and abstractions for language processing, powered by PyTorch

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Open Source Neural Machine Translation in PyTorch

Unified Communication X (mailing list - https://elist.ornl.gov/mailman/listinfo/ucx-group)

Unified Communication Collectives Library

Example pybind11 module built with a Python-based build system

Seamless operability between C++11 and Python

NeMo: a toolkit for conversational AI

PyTorch image models, scripts, pretrained weights -- ResNet, ResNeXT, EfficientNet, EfficientNetV2, NFNet, Vision Transformer, MixNet, MobileNet-V3/V2, RegNet, DPN, CSPNet, and more

Deep Learning Examples

A collection of research papers and software related to explainability in graph machine learning.

The website for PyTorch