Open
Description
What feature would you like to be added?
Several TODOs in ollama client:
- Add model families to directly supported models
- Deduplicate code between
openai
,azure
, andollama
model clients - Add argument checking
- Handle message source parameters
- Ensure token counting logic is correct
- Ensure constants (eg: done_reason) are still correct
- Check whether multiple content, images, and/or tools can/should exist within a single message
- Confirm streaming mode works properly
- Implement logprobs logic when it's added to the ollama client (see: Provide logits or logprobs in the API ollama/ollama#2415)
Why is this needed?
necessary to fully support the client