How good is your classifier? Revisiting the role of evaluation metrics in machine learning
1 347
11.2
Microsoft Research321 тыс
Следующее
07.05.20 – 4 35255:37Популярные
9 дней – 1 8126:36
Опубликовано 5 мая 2020, 21:47
With the increasing integration of machine learning into real systems, it is crucial that trained models are optimized to reflect real-world tradeoffs. Increasing interest in proper evaluation has led to a wide variety of metrics employed in practice, often specially designed by experts. However, modern training strategies have not kept up with the explosion of metrics, leaving practitioners to resort to heuristics.
To address this shortcoming, I will present a simple, yet consistent post-processing rule which improves the performance of trained binary, multilabel, and multioutput classifiers. Building on these results, I will propose a framework for metric elicitation, which addresses the broader question of how one might select an evaluation metric for real world problems so that it reflects true preferences.
See more at microsoft.com/en-us/research/v...
To address this shortcoming, I will present a simple, yet consistent post-processing rule which improves the performance of trained binary, multilabel, and multioutput classifiers. Building on these results, I will propose a framework for metric elicitation, which addresses the broader question of how one might select an evaluation metric for real world problems so that it reflects true preferences.
See more at microsoft.com/en-us/research/v...
Свежие видео
12 дней – 1931:31
19 дней – 129 0977:03
20 дней – 3831:35
20 дней – 168 48317:56
Случайные видео
15 дней – 164 99628:47
274 дня – 15 8370:26
11.08.22 – 1 9981:31
10.01.22 – 3 3191:02
27.10.20 – 43 5488:49
15.06.17 – 144 2228:47
3 дня – 1 2900:06
4 дня – 16 1554:47
4 дня – 4 4820:22
6 дней – 39210:08
6 дней – 3180:31
