TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Generation of diagrams like flowcharts or sequence diagrams from text in a similar manner as markdown

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

cuVS - a library for vector search and clustering on the GPU

A tool to configure, launch and manage your machine learning experiments.

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

A project to improve skills of large language models

State-of-the-Art Text Embeddings

Container plugin for Slurm Workload Manager

🦜🔗 Build context-aware reasoning applications

cuDF - GPU DataFrame Library

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

cuGraph - RAPIDS Graph Analytics Library

A modular graph-based Retrieval-Augmented Generation (RAG) system

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

A simple and efficient tool to parallelize Pandas operations on all available CPUs

A curated list of awesome LLM agents.

The official code repository for the second edition of the O'Reilly book Generative Deep Learning: Teaching Machines to Paint, Write, Compose and Play.

AAAI 2024 Papers: Explore a comprehensive collection of innovative research papers presented at one of the premier artificial intelligence conferences. Seamlessly integrate code implementations for…

LLMs and the Future of Chip Design: Unveiling Security Risks and Building Trust

Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

An open-source static random access memory (SRAM) compiler.

Intel® Performance Counter Monitor (Intel® PCM)