LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Dear ImGui: Bloat-free Graphical User interface for C++ with minimal dependencies

Port of OpenAI's Whisper model in C/C++

MLX: An array framework for Apple silicon

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Yoga is an embeddable layout engine targeting web standards.

Tensor library for machine learning

Tiny cross-platform webview library for C/C++. Uses WebKit (GTK/Cocoa) and Edge WebView2 (Windows).

WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices,…

🎤⌨️ Acoustic keyboard eavesdropping

Tiny data-over-sound library

🎛 🔊 A Python library for audio.

MindSpore is a new open source deep learning training/inference framework that could be used for mobile, edge and cloud scenarios.

Multi-channel signed distance field generator

Embedded Template Library

⚠️DirectML is in maintenance mode ⚠️ DirectML is a high-performance, hardware-accelerated DirectX 12 library for machine learning. DirectML provides GPU acceleration for common machine learning tas…

2D Vector Graphics Engine Powered by a JIT Compiler

Vulkan/CUDA/HIP/OpenCL/Level Zero/Metal Fast Fourier Transform library

INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model

Universal utility for programming FPGA

High performance build system for Windows, OSX and Linux. Supporting caching, network distribution and more.

Guitar plugin made with JUCE that uses neural networks to emulate a tube amplifier.

Portable header-only C++ low level SIMD library

JavaScript Engine Optimized for Lynx

C++20 coroutine library

C++14 asynchronous allocation aware futures (supporting then, exception handling, coroutines and connections)

Realtime DDSP Neural Synthesizer and Effect

C++ header-only fixed-point math library