Pattern Storage, Bifurcations, and Groupwise Correlation Structure of an Exactly Solvable Asymmetric Neural Network Model
2018
Despite their biological plausibility, neural network models with asymmetric weights are rarely solved analytically, and closed-form solutions are available only in some limiting cases or in some mean-field approximations. We found exact analytical solutions of an asymmetric spin model of neural networks with arbitrary size without resorting to any approximation, and we comprehensively studied its dynamical and statistical properties. The network had discrete time evolution equations and binary firing rates, and it could be driven by noise with any distribution. We found analytical expressions of the conditional and stationary joint probability distributions of the membrane potentials and the firing rates. By manipulating the conditional probability distribution of the firing rates, we extend to stochastic networks the associating learning rule previously introduced by Personnaz and coworkers. The new learning rule allowed the safe storage, under the presence of noise, of point and cyclic attractors, with...
Keywords:
- Machine learning
- Mathematical optimization
- Mathematics
- Expression (mathematics)
- Artificial intelligence
- Joint probability distribution
- Artificial neural network
- Spin model
- Discrete mathematics
- Learning rule
- Conditional probability distribution
- Discrete time and continuous time
- Attractor
- Biological plausibility
- Correlation
- Limiting
- Correction
- Source
- Cite
- Save
- Machine Reading By IdeaReader
71
References
8
Citations
NaN
KQI