Skip to content

[Executorch][llm] Make custom update cache op operate on indices #10610

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 8 commits into from
May 13, 2025
Merged

[Executorch][llm] Make custom update cache op operate on indices #10610

Changes from 1 commit
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
fd426c9
[Executorch][llm] Make custom update cache op operate on indices
kimishpatel May 1, 2025
28fab79
Update on "[Executorch][llm] Make custom update cache op operate on i…
kimishpatel May 5, 2025
a56c31f
Update on "[Executorch][llm] Make custom update cache op operate on i…
kimishpatel May 7, 2025
0ebbf5c
Update on "[Executorch][llm] Make custom update cache op operate on i…
kimishpatel May 8, 2025
5cbab1f
Update on "[Executorch][llm] Make custom update cache op operate on i…
kimishpatel May 9, 2025
d089855
Update on "[Executorch][llm] Make custom update cache op operate on i…
kimishpatel May 9, 2025
6176b62
Update on "[Executorch][llm] Make custom update cache op operate on i…
kimishpatel May 10, 2025
4c06366
Update on "[Executorch][llm] Make custom update cache op operate on i…
kimishpatel May 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Update on "[Executorch][llm] Make custom update cache op operate on i… 
…ndices"

This allows us to use ring buffer kv cache

Differential Revision: [D73891424](https://our.internmc.facebook.com/intern/diff/D73891424/)

[ghstack-poisoned]
  • Loading branch information
@kimishpatel
kimishpatel committed May 12, 2025
commit 4c063665c855e14a80204b22052330d67e3c3911

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.