Skip to content

workers ai model updates #21772

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Conversation

ashishdatta
Copy link
Contributor

@ashishdatta ashishdatta commented Apr 16, 2025

Summary

Mark the following for tool_calling

  • @cf/meta/llama-4-scout-17b-16e-instruct
  • @cf/mistral/mistral-small-3.1-24b-instruct
  • @cf/meta/llama-3.3-70b-instruct-fp8-fast

Mark the following for async

  • @cf/meta/llama-3.3-70b-instruct-fp8-fast

Fixed schemas

  • @cf/meta/llama-3.3-70b-instruct-fp8-fast

Screenshots (optional)

Documentation checklist

  • The documentation style guide has been adhered to.
  • If a larger change - such as adding a new page- an issue has been opened in relation to any incorrect or out of date information that this PR fixes.
  • Files which have changed name or location have been allocated redirects.

…ing and batching.

Updated schema to reflect batching schema. Fixed schema that was
incorrectly listing fields and defaults.
@cf/mistral/mistral-small-3.1-24b-instruct for tool_calling
@ashishdatta ashishdatta requested review from craigsdennis, pedrosousa and a team as code owners April 16, 2025 22:14
@ashishdatta ashishdatta changed the title Ashish/workers ai model schema updates workers ai model updates Apr 16, 2025
Copy link
Contributor

@craigsdennis craigsdennis left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This from API right?

@ashishdatta
Copy link
Contributor Author

This from API right?

Yessir!

@celso celso self-requested a review April 17, 2025 10:59
@kodster28 kodster28 merged commit 2c67326 into cloudflare:production Apr 17, 2025
5 checks passed
@workers-devprod workers-devprod added the contribution [Holopin] Recognizes a docs contribution, big or small label Apr 17, 2025
Copy link

holopin-bot bot commented Apr 17, 2025

Congratulations @ashishdatta, the maintainer of this repository has issued you a holobyte! Here it is: https://holopin.io/holobyte/cm9lfr5zj63720cl852vy1p4n

This badge can only be claimed by you, so make sure that your GitHub account is linked to your Holopin account. You can manage those preferences here: https://holopin.io/account.
Or if you're new to Holopin, you can simply sign up with GitHub, which will do the trick!

RebeccaTamachiro pushed a commit that referenced this pull request Apr 21, 2025
* Correctly mark @cf/meta/llama-3.3-70b-instruct-fp8-fast for tool calling and batching.

Updated schema to reflect batching schema. Fixed schema that was
incorrectly listing fields and defaults.

* Mark @cf/meta/llama-4-scout-17b-16e-instruct and
@cf/mistral/mistral-small-3.1-24b-instruct for tool_calling
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
contribution [Holopin] Recognizes a docs contribution, big or small size/m
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants