A game-theoretic perspective of deep neural networks
2023
We devote this paper to a theoretic analysis of deep neural networks from a game-theoretical perspective. We consider a general deep neural network with linear activation functions . We show that the deep neural network can be transformed into a non-atomic congestion game, regardless whether it is fully connected or locally connected. Moreover, we show that learning the weight and bias vectors of for a training set is equivalent to computing an optimal solution of the corresponding non-atomic congestion game. In particular, when is a deep neural network for a classification task, then the learning is equivalent to computing a Wardrop equilibrium of the corresponding non-atomic congestion game.
- Correction
- Source
- Cite
- Save
- Machine Reading By IdeaReader
0
References
0
Citations
NaN
KQI