Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with …

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

Utilities intended for use with Llama models.

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

A platform-independent file lock for Python.

A high-throughput and memory-efficient inference and serving engine for LLMs

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

OpenMMLab Detection Toolbox and Benchmark

Open source platform for the machine learning lifecycle

An example MLflow project

OpenMMLab Model Deployment Framework

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

Kaggle Python docker image