The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

Nano vLLM

This repository showcases various advanced techniques for Retrieval-Augmented Generation (RAG) systems. RAG systems combine information retrieval with generative models to provide accurate and cont…

llm theoretical performance analysis tools and support params, flops, memory and latency analysis.

欢迎star⭐。🚀从聊天记录创造数字分身的一站式解决方案💡 使用微信聊天记录微调大语言模型，让大模型有“那味儿”，并绑定到聊天机器人，实现自己的数字分身。 数字克隆/数字分身/数字永生/声音克隆/LLM/大语言模型/微信聊天机器人/LoRA

✨✨Latest Advances on Multimodal Large Language Models

This is a repo with links to everything you'd ever want to learn about data engineering

Graphic notes on Gilbert Strang's "Linear Algebra for Everyone"

List of papers studying machine learning through the lens of category theory

🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSy…

LLM101n: Let's build a Storyteller

Large Language Model (LLM) Systems Paper List

FlashInfer: Kernel Library for LLM Serving

Development repository for the Triton-Linalg conversion

Material for cuda-mode lectures

A Proof-oriented Programming Language

Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

🎉CUDA 笔记 / 高频面试题汇总 / C++笔记，个人笔记，更新随缘: sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.

MLIR For Beginners tutorial

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

Numbers every LLM developer should know

A curated list of practical guide resources of LLMs (LLMs Tree, Examples, Papers)

12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gan…