Tradeoffs between Robustness and Accuracy

Mon Oct 12, 2020 4:00 p.m.—5:00 p.m.
Aditi

This event has passed.

Aditi

Speaker

Aditi Raghunathan, Stanford University.

Standard machine learning produces models that are highly accurate on average but that degrade dramatically when the test distribution deviates from the training distribution. While one can train robust models, this often comes at the expense of standard accuracy (on the training distribution). We study this tradeoff in two settings: adversarial training to be robust to perturbations and upweighting minority groups to be robust to subpopulation shifts. We create simple examples which highlight generalization issues as a major source of this tradeoff. For adversarial examples, we show that even augmenting with correctly annotated data to promote robustness can produce less accurate models, but we develop a simple method, robust self-training, that mitigates this tradeoff using unlabeled data. For minority groups, we show that overparametrization of models can hurt accuracy on the minority groups, though it improves standard accuracy. These results suggest that the “more data” and “bigger models” strategy that works well for the standard setting where train and test distributions are close, need not work on out-of-domain settings.

This is based on joint work with Sang Michael Xie, Shiori Sagawa, Pang Wei Koh, Fanny Yang, John Duchi and Percy Liang.
Aditi Raghunathan’s website

You are invited to a scheduled Zoom meeting. Zoom is Yale’s audio and visual conferencing platform.

For H.323 and SIP information for video conferencing units