Skip to content

A research paper discovery platform that enables users to search the latest academic publications and interact with AI-powered analysis while providing full source citations and performance metrics.

Notifications You must be signed in to change notification settings

navchetna/ai-agents

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

AI Agents Framework

Setup

Run all services

  1. Build dataprep component
  2. Build retriever component
  3. Build backend component
  4. Build groq component
  5. Build ui component
export EMBEDDING_MODEL_ID="BAAI/bge-base-en-v1.5"
export RERANK_MODEL_ID="BAAI/bge-reranker-base"
export LLM_MODEL_ID="meta-llama/Meta-Llama-3-8B-Instruct"
export INDEX_NAME="rag-redis"
export REDIS_URL="redis://redis-vector-db:6379"
export MEGA_SERVICE_PORT=5008
export EMBEDDING_SERVER_HOST_IP=tei-embedding-service
export EMBEDDING_SERVER_PORT=80
export RETRIEVER_SERVICE_HOST_IP=retriever
export RETRIEVER_SERVICE_PORT=7000 
export RERANK_SERVER_HOST_IP=tei-reranking-service
export RERANK_SERVER_PORT=80 
export SERVER_HOST_URL=<host>:<port>
export HUGGINGFACEHUB_API_TOKEN=${your_hf_api_token}
export DATAPREP_OUT_DIR=</path/to/dataprep/out/dir>

Groq Serving (Recommended for PC):

export LLM_SERVER_HOST_IP=groq-service
export LLM_SERVER_PORT=8000
export GROQ_MODEL=llama-3.3-70b-versatile
export GROQ_API_KEY=${GROQ_API_KEY}

docker compose -f install/docker/docker-compose-groq.yaml up

VLLM Serving (Not required for PC):

export LLM_SERVER_HOST_IP=vllm-service
export LLM_SERVER_PORT=80

docker compose -f install/docker/docker-compose.yaml up

Note: host would be localhost for local dev or server hostname for remote server

About

A research paper discovery platform that enables users to search the latest academic publications and interact with AI-powered analysis while providing full source citations and performance metrics.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 7