Grammatical Structure Detection by Instinct Plasticity based Echo State Networks with Genetic Algorithm

Abstract A novel model called Instinct Plasticity Echo State Network with New Weights Selection Method, which is Optimized by Genetic Algorithm, is proposed (IP-NESN-GA). There are three proposed methods that are employed in the conventional ESN. New weights selection method provides a novel approach to replace the random weights of ESN, which obtains much better performance than the conventional ESN. At the same time, Instinct Plasticity is successfully applied in ESN, which enhances the connection among reservoir states and increase the accuracy. Finally, Genetic Algorithm is applied to seek the most suitable parameters. The detecting ability of our proposed model is assessed on two kinds of distinct grammatical constructions data. It not only performs significantly better than the baselines in the meaning error and sentence error, but it also visualizes the expected probabilities for each of the possible thematic roles.