'Entropy production rate' and 'entropy' for neural networks
1989
Two new quantities for neural networks, entropy production rate and entropy, are derived. In the Hopfield neural model, Hopfield introduced a quantity, energy, and the energy minimum corresponds to a possible good solution to a problem. It is shown that the energy function does not match the physical meaning of energy in physics; a better physical interpretation can go through entropy production rate and entropy in physics. These new quantities can be further extended to general nonequilibrium open systems for neural networks. >
Keywords:
- Real-time computing
- Maximum entropy probability distribution
- Joint entropy
- Entropy rate
- Configuration entropy
- Mathematical optimization
- Maximum entropy thermodynamics
- Entropy (energy dispersal)
- Joint quantum entropy
- Machine learning
- Maximum entropy spectral estimation
- Artificial intelligence
- Computer science
- Statistical physics
- Principle of maximum entropy
- Entropy production
- Correction
- Source
- Cite
- Save
- Machine Reading By IdeaReader
13
References
1
Citations
NaN
KQI