A nodejs llamba cpp terminal client. Based off of node-llama-cpp

• nodeenv - A node virtual environment
• node v21.7.0 - I was using 18 and it just wouldn't work

The ./setup.sh script:

• Creates a virtual environment
• Creates a models folder
• Downloads a model (big file!)

The ./go script:

• Starts the virtual environment
• Runs the nodejs server
• Exits the virtual environment on completion

You can use the [quit] command from the prompt or simply terminate the process.

• Allow files to be loaded.

# [load path] prompt
# Example
[load path\to\file.txt] Summarize this file

• Also allow [load ...] to download web pages

• Let the user choose from the models from the models folder at run time
• Allow users to download models from the