Skip to content

Conversation

@krrishdholakia
Copy link

@krrishdholakia krrishdholakia commented Aug 11, 2023

Hi @srush

Following on from this issue -#22. I'm working on litellm (simple library to standardize LLM API Calls - https://github.com/BerriAI/litellm) and was wondering if we could be helpful.

I added support for Palm, Claude, Azure, Cohere and Llama2 (via Replicate) by replacing the OpenAI endpoint with litellm. The code is pretty similar to the OpenAI class - as litellm follows the same pattern as the openai-python sdk.

Would love to know if this helps.

Happy to add additional tests / update documentation, if the initial PR looks good to you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant