Skip to content

Add continuous resource monitoring to AutoML.IMonitor #6520

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Changes from 1 commit
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
9647027
Fix a typo
andrasfuchs Nov 25, 2022
269b1bd
Fix trial cancellation bug
andrasfuchs Nov 25, 2022
a2c5781
Move performance related properties to TrialPerformanceMetrics and ad…
andrasfuchs Nov 25, 2022
e3fd992
Add new class and property explanations
andrasfuchs Nov 25, 2022
88fdefa
Revert "Fix trial cancellation bug"
andrasfuchs Dec 2, 2022
b03e46a
Remove pipeline info from the IMonitor Running event
andrasfuchs Dec 6, 2022
bf69dd2
Remove FreeSpaceOnDrives from TrialPerformanceMetrics
andrasfuchs Dec 6, 2022
38cf838
Change the default resource check interval to 5 seconds
andrasfuchs Dec 6, 2022
7f40df5
Remove StartedAtUtc property from TrialSettings
andrasfuchs Dec 22, 2022
8aa0ad8
move ReportTrialResourceUsage to IPerformanceMonitor
LittleLittleCloud Jan 3, 2023
739d865
Update AutoMLExperimentExtension.cs
LittleLittleCloud Jan 3, 2023
aeb651c
Merge pull request #2 from LittleLittleCloud/u/xiaoyun/add-cancellati…
andrasfuchs Jan 5, 2023
fc82c4c
Pause the performance monitor if the trial is not running
andrasfuchs Jan 6, 2023
d0ce0cd
Add StartedAtUtc and EndedAtUtc to TrialSettings
andrasfuchs Jan 8, 2023
4149a4b
cancel trial when as is
LittleLittleCloud Feb 6, 2023
7d3257a
fix tests
LittleLittleCloud Feb 6, 2023
c5c2d83
Merge branch 'main' into add-cancellation-and-resource-monitoring-to-…
LittleLittleCloud Feb 7, 2023
3919324
fix tests
LittleLittleCloud Feb 7, 2023
13ba949
fix tests
LittleLittleCloud Feb 7, 2023
488ff20
use workingset to evaluate memory usage
LittleLittleCloud Feb 8, 2023
49ac8ae
remove handler
LittleLittleCloud Feb 8, 2023
3722dcb
add handler back
LittleLittleCloud Feb 8, 2023
ff55857
add more logging
LittleLittleCloud Feb 8, 2023
509f963
add more logger
LittleLittleCloud Feb 8, 2023
1240335
add logging
LittleLittleCloud Feb 9, 2023
5a27af4
fix tests
LittleLittleCloud Feb 9, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix tests
  • Loading branch information
LittleLittleCloud committed Feb 7, 2023
commit 3919324c3fd258b30d8f6e6a026729ac22cfd372
2 changes: 1 addition & 1 deletion test/Microsoft.ML.AutoML.Tests/AutoMLExperimentTests.cs
Original file line number Diff line number Diff line change
Expand Up @@ -73,7 +73,7 @@ public async Task AutoMLExperiment_cancel_trial_when_exceeds_memory_limit_Async(
// the following experiment set memory usage limit to 0.01mb
// so all trials should be canceled and there should be no successful trials.
// therefore when experiment finishes, it should throw timeout exception with no model trained message.
experiment.SetTrainingTimeInSeconds(10)
experiment.SetMaxModelToExplore(10)
.SetTrialRunner((serviceProvider) =>
{
var channel = serviceProvider.GetService<IChannel>();
Expand Down