Talks
Summer 2019

Size-free Generalization Bounds for Convolutional Neural Networks

Monday, July 15th, 2019, 3:15 pm4:00 pm

Add to Calendar

Speaker: 

Hanie Sedghi (Google Brain)

We prove bounds on the generalization error of convolutional networks. The bounds are in terms of the training loss, the number of
parameters, the Lipschitz constant of the loss and the distance from the weights to the initial weights. They are independent of the number of pixels in the input, and the height and width of hidden feature maps. We present experiments with CIFAR-10 and a scaled-down variant, along with varying hyperparameters of a deep convolutional network, comparing our bounds with practical generalization gaps.