Support local deployment of AI models.

[yuntu297]

Does it support customizable HTTP APIs?

[dylanbouchard]

@yuntu297 thank you for starting this discussion and apologies for the delayed response!

Currently, generation with uqlm.scorer classes (BlackBoxUQ, WhiteBoxUQ, LLMPanel, UQEnsemble) requires an instance of a LangChain BaseChatModel. I'm not sure whether customizable HTTP APIs are support with these classes.

If not, and this is a feature you would like uqlm to support, please feel free to create an issue for this. Thank you!