OpenAI swift async text to image for SwiftUI app using OpenAI
Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
Optimizing inference proxy for LLMs
User-friendly AI Interface
Port of Facebook's LLaMA model in C/C++
Self-hosted, community-driven, local OpenAI compatible API
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Ready-to-use OCR with 80+ supported languages
A RWKV management and startup tool, full automation, only 8MB
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Replace OpenAI GPT with another LLM in your app
AIMET is a library that provides advanced quantization and compression
Phi-3.5 for Mac: Locally-run Vision and Language Models
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Easiest and laziest way for building multi-agent LLMs applications
Easy-to-use deep learning framework with 3 key features
A high-throughput and memory-efficient inference and serving engine
An MLOps framework to package, deploy, monitor and manage models
Integrate, train and manage any AI models and APIs with your database
Sparsity-aware deep learning inference runtime for CPUs
OpenMLDB is an open-source machine learning database
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere
Multilingual Automatic Speech Recognition with word-level timestamps
Single-cell analysis in Python