Almost Surely Asymptotic Freeness for Jacobian Spectrum of Deep Network.

Free probability theory helps us to understand Jacobian spectrum of deep neural networks. We rigorously show almost surely asymptotic freeness of layer-wise Jacobians.