Multi-channel surround sound dynamic binaural replaying method based on body-sensing camera

The invention discloses a multi-channel surround sound dynamic binaural replaying method based on a body-sensing camera. The method includes steps: 1) inputting initial data, wherein the data comprises position parameters of virtual loudspeakers and head related transfer function data; 2) detecting motion data of the head of a listener in real time by employing the body-sensing camera, and calculating the space direction of the head after rotation; 3) calling a corresponding head related transfer function principal component decomposition coefficient according to the space direction of the head of the listener after rotation, multiplying input multi-channel surround sound signals by the coefficient, and performing filtering by employing a common filter group obtained by decomposition of head related transfer functions; and 4) mixing output signals of the common filter group, and obtaining binaural replaying signals of multi-channel surround sound for replaying by an earphone after filtering equalization processing. According to the method, the motion information of the head is obtained by employing the body-sensing camera, each virtual loudspeaker of the multi-channel surround sound is dynamically simulated in real time, and the similar effect of replaying the multi-channel surround sound by the loudspeakers is produced.