Skip to content

Added RankingEvaluatorOptions and removed the truncation limit. #4081

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 58 commits into from
Oct 10, 2019
Merged
Changes from 1 commit
Commits
Show all changes
58 commits
Select commit Hold shift + click to select a range
8749a10
Merge pull request #1 from dotnet/master
harishsk Jun 20, 2019
fe25bf6
Fixed build errors resulting from upgrade to VS2019 compilers
harishsk Jun 21, 2019
cb446be
Added additional message describing the previous fix
harishsk Jun 21, 2019
b5ee220
Merge pull request #2 from dotnet/master
harishsk Jun 21, 2019
b9a7471
Merge pull request #3 from dotnet/master
harishsk Jun 24, 2019
80e238d
Merge pull request #4 from dotnet/master
harishsk Jun 27, 2019
2ef424d
Merge pull request #5 from dotnet/master
harishsk Jul 9, 2019
3958f01
Merge pull request #6 from dotnet/master
harishsk Aug 7, 2019
56d4595
Fixed #3993
harishsk Aug 7, 2019
00bc7ef
Merge pull request #7 from dotnet/master
harishsk Aug 14, 2019
d0462f1
Merge pull request #8 from dotnet/master
harishsk Aug 16, 2019
87cefbc
Merge branch 'master' into bugfix_3993
harishsk Aug 16, 2019
c3a908b
Reverted previous change and added a separate class to control evalua…
harishsk Aug 21, 2019
c0a430a
Merge pull request #9 from dotnet/master
harishsk Aug 21, 2019
0b55903
Syncing upstream fork (#10)
harishsk Aug 30, 2019
56983d5
Syncing upstream fork (#11)
harishsk Aug 30, 2019
3382d1d
Merge pull request #13 from dotnet/master
harishsk Sep 6, 2019
8ca5d01
Merge remote-tracking branch 'upstream/master'
harishsk Sep 10, 2019
4ac459e
Added unit test for ranking evaluation with options
harishsk Sep 11, 2019
8f20ea4
Merge remote-tracking branch 'upstream/master'
harishsk Sep 11, 2019
f9f9e1d
Changed visibility of OutputGroupSummary to internal until we expose …
harishsk Sep 11, 2019
21cb8f3
Added a unit test for maml ranking evaluation
harishsk Sep 12, 2019
138f201
Merge remote-tracking branch 'upstream/master'
harishsk Sep 13, 2019
55e3460
Merge remote-tracking branch 'upstream/master'
harishsk Sep 13, 2019
e43bba3
Merge remote-tracking branch 'upstream/master'
harishsk Sep 16, 2019
421d713
Merge branch 'master' of ssh://github.com/harishsk/machinelearning
harishsk Sep 16, 2019
4f4f81c
Merge remote-tracking branch 'upstream/master'
harishsk Sep 17, 2019
89082a5
Merge branch 'master' into bugfix_3993
harishsk Sep 17, 2019
f167af8
Merge branch 'master' of ssh://github.com/harishsk/machinelearning
harishsk Sep 17, 2019
0d4d34f
getting rid of maxTruncationLevel
Lynx1820 Sep 18, 2019
6cd2f15
removed unnecessary imports
Lynx1820 Sep 18, 2019
1424ab3
removed old comment
Lynx1820 Sep 18, 2019
3ee03ca
removed old comment
Lynx1820 Sep 18, 2019
34b7a91
Merge remote-tracking branch 'upstream/master'
harishsk Sep 19, 2019
5539127
Merge remote-tracking branch 'upstream/master'
harishsk Sep 19, 2019
02053a6
adding a maml baseline test
Lynx1820 Sep 23, 2019
35ad3c0
reformatted maml test and moved to where all the other maml tests are
Lynx1820 Sep 25, 2019
0eb3e2b
Reverted back some spacing. Accidentally reverted some changes in Eva…
Lynx1820 Sep 25, 2019
a3291b1
added more relaxed precision
Lynx1820 Sep 25, 2019
37af437
Merge remote-tracking branch 'upstream/master'
harishsk Sep 26, 2019
68f1f35
baseline precision set 1
Lynx1820 Sep 26, 2019
5b90a34
added more helpful debugging comment
Lynx1820 Sep 26, 2019
0efe238
temp
Lynx1820 Sep 27, 2019
b6584aa
Merge remote-tracking branch 'upstream/master'
harishsk Sep 27, 2019
7d47832
Merge branch 'master' of ssh://github.com/harishsk/machinelearning
harishsk Sep 27, 2019
0e99776
Merge branch 'master' into bugfix_3993
harishsk Sep 27, 2019
20a4490
Revert "temp"
Lynx1820 Sep 30, 2019
0d111f4
Revert "added more relaxed precision"
Lynx1820 Sep 30, 2019
72d1a4d
using fastRankRanking to test RankingEvaluator instead of lightgbm
Lynx1820 Sep 30, 2019
ea9ebed
Merge branch 'bugfix_3993' of git://github.com/harishsk/machinelearni…
Lynx1820 Sep 30, 2019
013be4f
reverted some indenting and LightGBM imports
Lynx1820 Sep 30, 2019
d2ae365
removed the stratification flag to get real numbers
Lynx1820 Oct 7, 2019
a9e6db8
testcase change added
Lynx1820 Oct 7, 2019
5855f99
Added the Bestfriend attribute back
Lynx1820 Oct 7, 2019
724bb12
Changed implementation of discount map computation to minimize mutabl…
harishsk Oct 9, 2019
d009f55
Added doc strings
harishsk Oct 9, 2019
8f7b6cd
Fixed bug in creation of fixed discount map
harishsk Oct 9, 2019
30d56a0
Merge remote-tracking branch 'upstream/master' into bugfix_3993
harishsk Oct 10, 2019
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
removed the stratification flag to get real numbers
  • Loading branch information
Lynx1820 committed Oct 7, 2019
commit d2ae36564c7caa0d6246f07935523e3c057ac717
126 changes: 63 additions & 63 deletions test/BaselineOutput/Common/Command/EvaluateRankingWithMaml-out.txt
Original file line number Diff line number Diff line change
@@ -1,83 +1,83 @@
maml.exe CV tr=FastRankRanking{t=1} eval=RankingEvaluator{t=10} strat=Strat threads=- norm=Warn prexf=rangefilter{col=Label min=20 max=25} prexf=term{col=Strat:Label} loader=text{col=Features:R4:10-14 col=Label:R4:9 col=GroupId:TX:1 header+} data=%Data% out=%Output% xf=term{col=Label} xf=hash{col=GroupId}
maml.exe CV tr=FastRankRanking{t=1} eval=RankingEvaluator{t=10} threads=- norm=Warn prexf=rangefilter{col=Label min=20 max=25} prexf=term{col=Strat:Label} loader=text{col=Features:R4:10-14 col=Label:R4:9 col=GroupId:TX:1 header+} data=%Data% out=%Output% xf=term{col=Label} xf=hash{col=GroupId}
Not adding a normalizer.
Making per-feature arrays
Changing data from row-wise to column-wise
Processed 40 instances
Processed 38 instances
Binning and forming Feature objects
Reserved memory for tree learner: %Number% bytes
Starting to train ...
Not training a calibrator because it is not needed.
Not adding a normalizer.
Making per-feature arrays
Changing data from row-wise to column-wise
Processed 32 instances
Processed 34 instances
Binning and forming Feature objects
Reserved memory for tree learner: %Number% bytes
Starting to train ...
Not training a calibrator because it is not needed.
NDCG@1: 0.000000
NDCG@2: 0.000000
NDCG@3: 0.000000
NDCG@4: 0.000000
NDCG@5: 0.000000
NDCG@6: 0.000000
NDCG@7: 0.000000
NDCG@8: 0.000000
NDCG@9: 0.000000
NDCG@10: 0.000000
DCG@1: 0.000000
DCG@2: 0.000000
DCG@3: 0.000000
DCG@4: 0.000000
DCG@5: 0.000000
DCG@6: 0.000000
DCG@7: 0.000000
DCG@8: 0.000000
DCG@9: 0.000000
DCG@10: 0.000000
NDCG@1: 0.000000
NDCG@2: 0.000000
NDCG@3: 0.000000
NDCG@4: 0.000000
NDCG@5: 0.000000
NDCG@6: 0.000000
NDCG@7: 0.000000
NDCG@8: 0.000000
NDCG@9: 0.000000
NDCG@10: 0.000000
DCG@1: 0.000000
DCG@2: 0.000000
DCG@3: 0.000000
DCG@4: 0.000000
DCG@5: 0.000000
DCG@6: 0.000000
DCG@7: 0.000000
DCG@8: 0.000000
DCG@9: 0.000000
DCG@10: 0.000000
NDCG@1: 0.852151
NDCG@2: 0.812691
NDCG@3: 0.833123
NDCG@4: 0.832012
NDCG@5: 0.868823
NDCG@6: 0.875724
NDCG@7: 0.875724
NDCG@8: 0.875724
NDCG@9: 0.875724
NDCG@10: 0.875724
DCG@1: 16.470768
DCG@2: 20.946111
DCG@3: 23.891614
DCG@4: 24.927172
DCG@5: 27.206124
DCG@6: 27.848497
DCG@7: 27.848497
DCG@8: 27.848497
DCG@9: 27.848497
DCG@10: 27.848497
NDCG@1: 0.673118
NDCG@2: 0.715724
NDCG@3: 0.742017
NDCG@4: 0.774032
NDCG@5: 0.811047
NDCG@6: 0.811657
NDCG@7: 0.817541
NDCG@8: 0.818655
NDCG@9: 0.818655
NDCG@10: 0.818655
DCG@1: 21.255707
DCG@2: 23.804377
DCG@3: 26.160779
DCG@4: 29.018919
DCG@5: 31.288569
DCG@6: 31.391349
DCG@7: 31.872247
DCG@8: 31.963271
DCG@9: 31.963271
DCG@10: 31.963271

OVERALL RESULTS
---------------------------------------
NDCG@1: 0.000000 (0.0000)
NDCG@2: 0.000000 (0.0000)
NDCG@3: 0.000000 (0.0000)
NDCG@4: 0.000000 (0.0000)
NDCG@5: 0.000000 (0.0000)
NDCG@6: 0.000000 (0.0000)
NDCG@7: 0.000000 (0.0000)
NDCG@8: 0.000000 (0.0000)
NDCG@9: 0.000000 (0.0000)
NDCG@10: 0.000000 (0.0000)
DCG@1: 0.000000 (0.0000)
DCG@2: 0.000000 (0.0000)
DCG@3: 0.000000 (0.0000)
DCG@4: 0.000000 (0.0000)
DCG@5: 0.000000 (0.0000)
DCG@6: 0.000000 (0.0000)
DCG@7: 0.000000 (0.0000)
DCG@8: 0.000000 (0.0000)
DCG@9: 0.000000 (0.0000)
DCG@10: 0.000000 (0.0000)
NDCG@1: 0.762634 (0.0895)
NDCG@2: 0.764207 (0.0485)
NDCG@3: 0.787570 (0.0456)
NDCG@4: 0.803022 (0.0290)
NDCG@5: 0.839935 (0.0289)
NDCG@6: 0.843691 (0.0320)
NDCG@7: 0.846632 (0.0291)
NDCG@8: 0.847189 (0.0285)
NDCG@9: 0.847189 (0.0285)
NDCG@10: 0.847189 (0.0285)
DCG@1: 18.863238 (2.3925)
DCG@2: 22.375244 (1.4291)
DCG@3: 25.026196 (1.1346)
DCG@4: 26.973046 (2.0459)
DCG@5: 29.247346 (2.0412)
DCG@6: 29.619923 (1.7714)
DCG@7: 29.860372 (2.0119)
DCG@8: 29.905884 (2.0574)
DCG@9: 29.905884 (2.0574)
DCG@10: 29.905884 (2.0574)

---------------------------------------
Physical memory usage(MB): %Number%
Expand Down