Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 16+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

A Datacenter Scale Distributed Inference Serving Framework

Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

Chronon is a data platform for serving for AI/ML applications.

A cloud-native vector database, storage for next generation AI applications

Build highly concurrent, distributed, and resilient message-driven applications using Java/Scala

🚀 Build and manage real-life data science projects with ease!

Multilingual Sentence & Image Embeddings with BERT

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

Examples and recipes for Llama 2 model

QLoRA: Efficient Finetuning of Quantized LLMs

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

Awesome-LLM: a curated list of Large Language Model

Distributed PyTorch implementation of multi-headed graph convolutional neural networks

Large Language Model Text Generation Inference

workshop materials to build intelligent solutions on Open AI

End-to-end stack for WebRTC. SFU media server and SDKs.

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch…

A collection of machine learning examples and tutorials.

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

⚡ Building applications with LLMs through composability ⚡

Apache Atlas

A Generic Low-Code Framework Built on a Config-Driven Tree Walker

Header-only C++/python library for fast approximate nearest neighbors

Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.