Lists (15)
Sort Name ascending (A-Z)
Stars
The ultimate LLM/AI application development framework in Golang.
Cost-efficient and pluggable Infrastructure components for GenAI inference
Supercharge Your LLM with the Fastest KV Cache Layer
Evergreen, contamination-free, real-world, domain-specific AI evaluation framework
KDP(Kubernetes Data Platform) delivers a modern, hybrid and cloud-native data platform based on Kubernetes.
A task runner / simpler Make alternative written in Go
A Kubernetes MCP (Model Control Protocol) server that enables interaction with Kubernetes clusters through MCP tools.
DLRover: An Automatic Distributed Deep Learning System
AIInfra(AI 基础设施)指AI系统从底层芯片等硬件,到上层软件栈支持AI大模型训练和推理。
libfaketime modifies the system time for a single application
参考《自己动手写 docker》从零开始实现一个简易的 docker 以及相关教程。Build a simple Docker from scratch along with related tutorials.
🚢 Yet another operator for running large language models on Kubernetes with ease. Powered by Ollama! 🐫
An awesome & curated list of best LLMOps tools for developers
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
git-lfs Custom transfer agent which simply works with an S3 provider
Heterogeneous AI Computing Virtualization Middleware(Project under CNCF)
An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!