Topology and geometry of deep rectified network optimization landscapes

2016

Abstract

The loss surface of deep neural networks has recently attracted interest in the optimization and machine learning communities as a prime example of highdimensional non-convex problem. Some insights were recently gained using spin glass models and mean-field …

Authors

Daniel Freeman
Joan Bruna