-
Notifications
You must be signed in to change notification settings - Fork 999
Add model_request_stream_sync
to direct API
#2116
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add model_request_stream_sync
to direct API
#2116
Conversation
model_request_stream_sync
`model_request_stream_sync
cb65100
to
285328b
Compare
PR Change SummaryAdded support for synchronous streamed requests in the API documentation.
Modified Files
How can I customize these reviews?Check out the Hyperlint AI Reviewer docs for more information on how to customize the review. If you just want to ignore it on this PR, you can add the Note specifically for link checks, we only check the first 30 links in a file and we cache the results for several hours (for instance, if you just added a page, you might experience this). Our recommendation is to add |
model_request_stream_sync
model_request_stream_sync
to direct API
@hewliyang Nice work, thanks! We'll release this early next week |
closes #2096
model_request_stream
with some threading overhead