A high-throughput and memory-efficient inference and serving engine for LLMs

Accelerate inference of 🤗 Transformers with Intel optimization tools

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

Large Language Model Text Generation Inference on Habana Gaudi

A framework for few-shot evaluation of language models.

GenAI components at micro-service level; GenAI service composer to create mega-service

Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety, and hallucination

🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools

A framework for the evaluation of autoregressive code generation language models.

Extending Hugging Face transformers APIs for Transformer-based models and improve the productivity of inference deployment. With extremely compressed models, the toolkit can greatly improve the inf…

This is a Chinese translation of the CUDA programming guide

计算机的优秀课程

🤗 Transformers: State-of-the-art Natural Language Processing for Pytorch, TensorFlow, and JAX.

Intel® Low Precision Optimization Tool, targeting to provide a unified low precision inference interface cross different deep learning frameworks, and support auto-tune with specified accuracy crit…