Skip to content

Update server documentation with new mmproj configuration options #13431

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
kth8 opened this issue May 10, 2025 · 3 comments
Closed

Update server documentation with new mmproj configuration options #13431

kth8 opened this issue May 10, 2025 · 3 comments

Comments

@kth8
Copy link

kth8 commented May 10, 2025

The LLaMA.cpp HTTP Server README currently lacks documentation for the new mmproj configuration options, which were updated in #13416 that can be set via command line arguments or environment variables.

@ngxson
Copy link
Collaborator

ngxson commented May 10, 2025

It's already there, please read the doc carefully:

Image

@ngxson ngxson closed this as completed May 10, 2025
@kth8
Copy link
Author

kth8 commented May 10, 2025

@ngxson I saw https://github.com/ggml-org/llama.cpp/blob/master/docs/multimodal.md but that doesn't document all the mmproj command line options along with their corresponding environment variables like the server README does. I think it would be beneficial to have all the command line arguments and environment variables documented in a central place for easy discoverability.

@ngxson
Copy link
Collaborator

ngxson commented May 10, 2025

It will be addressed in #13432

It's not a really related issue, but because the table is auto-generated, we do a periodically update of the list of args

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants