Skip to content

Easing getting started for developers on their laptop #311

Closed as not planned
Closed as not planned
@mkbhanda

Description

@mkbhanda

Most developers would like to use just their laptop or desktop to get started with OPEA - to explore what it is, change a few minor things and deliver smaller features. Would be nice to support this using
a one node Kubernetes cluster, skip re-ranker (we already have docker compose and helm charts without this), and using a smaller model (2-3B parameters, look on HuggingFace Hub for one == this is an environment variable setting).
Perhaps we use the Ollama model server. Essentially use components that are most suitable for a low resource environment. Would like this added to the getting started guide. Please also add instructions that might be pertinent to using a Windows Subsystem (WSL) for Linux environment.

  1. docker-compose and/or helm chart
  2. test it all works
  3. documentation.

Please reach out for help/tips from:
@alexsin368: pointers to publish documentation on getting-started and for Kubernetes.
@pbharti0831: pointers to use Ollama and a small model.

Metadata

Metadata

Assignees

No one assigned

    Labels

    A3MaintainOPEAHackIssue created for OPEA HackathonStaledocumentationImprovements or additions to documentationgood first issueGood for newcomershelp wantedExtra attention is needed

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions