Add command mode to interactive mode.

[wbpxre150]

Allows changing of startup params on the fly using ??? Command Argument.

For example: ??? top_k 50 changes the top_k value to 50.

Can anyone test this and comment here with their findings?

[grencez]

I don't think context_size can change. It's used to initialize the ctx.
Not sure if there are edge cases for keep or n_predict. It seems odd to want to change those.
The other settings (and n_threads if you want) can be changed dynamically (I did something similar in a dependent project).

[wbpxre150]

I didn't test which values work and which do not, just that they set and nothing crashes. Thanks for the heads up. I like your project also, looks interesting! I will do some investigation and testing of parameters and add some documentation over the next couple of days using your work as an example :)