-
Notifications
You must be signed in to change notification settings - Fork 542
Reland minibench refactor #10417
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Reland minibench refactor #10417
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/10417
Note: Links to docs will display an error until the docs builds have been completed. ❌ 2 New FailuresAs of commit 097d4d5 with merge base d31ef13 ( NEW FAILURES - The following jobs have failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
b9033c8
to
dd30524
Compare
@kirklandsign has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
dd30524
to
097d4d5
Compare
@kirklandsign has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
Reland ebab7bb
Resolved: #8578
Test Plan: See this one has meaningful result https://hud.pytorch.org/benchmark/llms?startTime=Thu,%2017%20Apr%202025%2017:56:13%20GMT&stopTime=Thu,%2024%20Apr%202025%2017:56:13%20GMT&granularity=day&repoName=pytorch%2Fexecutorch&benchmarkName=&modelName=meta-llama%2FLlama-3.2-1B-Instruct-QLORA_INT4_EO8&backendName=llama3_qlora&modeName=inference&dtypeName=&deviceName=Samsung%20Galaxy%20S22%205G%20(Android%2013)&archName=All%20Platforms