Description
Most developers would like to use just their laptop or desktop to get started with OPEA - to explore what it is, change a few minor things and deliver smaller features. Would be nice to support this using
a one node Kubernetes cluster, skip re-ranker (we already have docker compose and helm charts without this), and using a smaller model (2-3B parameters, look on HuggingFace Hub for one == this is an environment variable setting).
Perhaps we use the Ollama model server. Essentially use components that are most suitable for a low resource environment. Would like this added to the getting started guide. Please also add instructions that might be pertinent to using a Windows Subsystem (WSL) for Linux environment.
- docker-compose and/or helm chart
- test it all works
- documentation.
Please reach out for help/tips from:
@alexsin368: pointers to publish documentation on getting-started and for Kubernetes.
@pbharti0831: pointers to use Ollama and a small model.