AIMET is a library that provides advanced quantization and compression
Easy-to-use deep learning framework with 3 key features
An MLOps framework to package, deploy, monitor and manage models
Standardized Serverless ML Inference Platform on Kubernetes
Library for OCR-related tasks powered by Deep Learning
Superduper: Integrate AI models and machine learning workflows
Official inference library for Mistral models
OpenMMLab Model Deployment Framework
A GPU-accelerated library containing highly optimized building blocks
Unified Model Serving Framework
A unified framework for scalable computing
A set of Docker images for training and serving models in TensorFlow
Neural Network Compression Framework for enhanced OpenVINO
Framework that is dedicated to making neural data processing
Library for serving Transformers models on Amazon SageMaker
Powering Amazon custom machine learning chips
A computer vision framework to create and deploy apps in minutes
Toolkit for allowing inference and serving with MXNet in SageMaker
Deploy a ML inference service on a budget in 10 lines of code