Port of OpenAI's Whisper model in C/C++
High-performance neural network inference framework for mobile
Easy-to-use deep learning framework with 3 key features
PArallel Distributed Deep LEarning: Machine Learning Framework
Everything you need to build state-of-the-art foundation models
Bring the notion of Model-as-a-Service to life
Framework that is dedicated to making neural data processing
An MLOps framework to package, deploy, monitor and manage models
AICI: Prompts as (Wasm) Programs
Trainable models and NN optimization tools
Neural Network Compression Framework for enhanced OpenVINO
A Pythonic framework to simplify AI service building
Build Production-ready Agentic Workflow with Natural Language
OpenMMLab Model Deployment Framework
A unified framework for scalable computing
A library for accelerating Transformer models on NVIDIA GPUs
Efficient few-shot learning with Sentence Transformers
Bolt is a deep learning library with high performance
Unified Model Serving Framework
A set of Docker images for training and serving models in TensorFlow
Framework which allows you transform your Vector Database
An Open-Source Programming Framework for Agentic AI
A high-performance ML model serving framework, offers dynamic batching
Superduper: Integrate AI models and machine learning workflows
Turn your existing data infrastructure into a feature store