Download
LitGPT is a collection of over 20 high-performance large language models (LLMs) accompanied by recipes to pretrain, finetune, and deploy them at scale. It provides implementations without abstractions, making it beginner-friendly while offering advanced features like flash attention and support for various precision levels. LitGPT is designed to run efficiently across multiple GPUs or TPUs, catering to both small-scale and large-scale deployments.
Features
- Collection of 20+ high-performance LLMs
- Recipes for pretraining and finetuning models
- Scalable deployment across GPUs and TPUs
- Beginner-friendly implementations without abstractions
- Support for flash attention mechanisms
- Flexible precision levels (fp4/8/16/32)
- Integration with Lightning AI platform
- Extensive tutorials and documentation
- Active community and support channels
Project Samples
Categories
LLM InferenceLicense
Apache License V2.0Follow LitGPT
Other Useful Business Software
Level Up Your Cyber Defense with External Threat Management
Move beyond alerts. Gain full visibility, context, and control over your external attack surface to stay ahead of every threat.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of LitGPT!