Skip to content

Add DcgTruncationLevel to Ranking AutoML API #5425

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
jwood803 opened this issue Oct 9, 2020 · 0 comments
Open

Add DcgTruncationLevel to Ranking AutoML API #5425

jwood803 opened this issue Oct 9, 2020 · 0 comments
Assignees
@michaelgsharp
Labels
API Issues pertaining the friendly API AutoML.NET Automating various steps of the machine learning process enhancement New feature or request

Comments

@jwood803
Copy link
Contributor

jwood803 commented Oct 9, 2020

When performing Ranking in AutoML, it will always return back a length of 3 in the DCG and nDCG metrics. However, when using the Evaluate method for Ranking, it has a property in the RankingEvaluatorOptions to specify the DcgTruncationLevel.

var rankingEvaluatorOptions = new RankingEvaluatorOptions { DcgTruncationLevel = 10 };

This was noticed when adding the Ranking AutoML sample in this comment
@jwood803 jwood803 mentioned this issue Oct 9, 2020
Merged
@michaelgsharp michaelgsharp added API Issues pertaining the friendly API AutoML.NET Automating various steps of the machine learning process enhancement New feature or request labels Oct 9, 2020
@michaelgsharp michaelgsharp self-assigned this Oct 9, 2020
@michaelgsharp michaelgsharp mentioned this issue Oct 13, 2020
Merged
@jwood803 jwood803 mentioned this issue Oct 20, 2020
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@michaelgsharp michaelgsharp

Labels
API Issues pertaining the friendly API AutoML.NET Automating various steps of the machine learning process enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jwood803 @michaelgsharp