Inference code for Llama models

Generation of diagrams like flowcharts or sequence diagrams from text in a similar manner as markdown

An annotated implementation of the Transformer paper.

《大模型白盒子构建指南》：一个全手搓的Tiny-Universe

《开源大模型食用指南》针对中国宝宝量身打造的基于Linux环境快速微调（全参数/Lora）、部署国内外开源大模型（LLM）/多模态大模型（MLLM）教程

Code for the paper "Language Models are Unsupervised Multitask Learners"

Memray is a memory profiler for Python

Hands-On GPU Programming with Python and CUDA, published by Packt

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

Video+code lecture on building nanoGPT from scratch

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

verl: Volcano Engine Reinforcement Learning for LLMs

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

The official Typescript SDK for Model Context Protocol servers and clients

DeerFlow is a community-driven Deep Research framework, combining language models with tools like web search, crawling, and Python execution, while contributing back to the open-source community.

A guidance language for controlling large language models.

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

FlashInfer: Kernel Library for LLM Serving

腾讯柠檬清理是针对macOS系统专属制定的清理工具。主要功能包括重复文件和相似照片的识别、软件的定制化垃圾扫描、可视化的全盘空间分析、内存释放、浏览器隐私清理以及设备实时状态的监控等。重点聚焦清理功能，对上百款软件提供定制化的清理方案，提供专业的清理建议，帮助用户轻松完成一键式清理。

The simplest, fastest repository for training/finetuning medium-sized GPTs.

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

A Datacenter Scale Distributed Inference Serving Framework

🌐 Make websites accessible for AI agents. Automate tasks online with ease.

收集和梳理垂直领域的开源模型、数据集及评测基准。

LangChain for Go, the easiest way to write LLM-based programs in Go

Integrate the DeepSeek API into popular softwares