LLM
Collection of awesome LLM apps with AI Agents and RAG using OpenAI, Anthropic, Gemini and opensource models.
A library for prompt engineering and optimization (SAMMO = Structure-aware Multi-Objective Metaprompt Optimization)
AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data…
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step
[CCS'24] A dataset consists of 15,140 ChatGPT prompts from Reddit, Discord, websites, and open-source datasets (including 1,405 jailbreak prompts).
Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.
A simple screen parsing tool towards pure vision based GUI agent
🌐 Make websites accessible for AI agents. Automate tasks online with ease.
Chat with your database or your datalake (SQL, CSV, parquet). PandasAI makes data analysis conversational using LLMs and RAG.
The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.
Model Context Protocol Servers
LOTUS: A semantic query engine for fast and easy LLM-powered data processing
A high-throughput and memory-efficient inference and serving engine for LLMs
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
The Open Source Memory Layer For Autonomous Agents
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Task-Aware Agent-driven Prompt Optimization Framework
Distribute and run LLMs with a single file.
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Awesome-LLM: a curated list of Large Language Model
Turn any webpage into structured data using LLMs
Crawl a site to generate knowledge files to create your own custom GPT from a URL
Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous …
Scira (Formerly MiniPerplx) is a minimalistic AI-powered search engine that helps you find information on the internet and cites it too. Powered by Vercel AI SDK! Search with models like xAI's Grok 3.
🚀🤖 Crawl4AI: Open-source LLM Friendly Web Crawler & Scraper. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization