Inception and ResNet: Same Training, Same Features

Deep convolutional neural networks (CNNs) are the dominant technology in computer vision today. Unfortunately, it’s not clear how different from each other the best CNNs really are. This paper measures the similarity between two well-known CNNs, Inception and ResNet, in terms of the features they extract from images. We find that Inception’s features can be well approximated as an affine transformation of ResNet’s features and vice-versa.