Endoscopic surgery assistance system and method for controlling image

An endoscope system according to one embodiment of the present technology comprises a head mounted display, a detection unit and a controller. The head mounted display is mounted on an operator. The detection unit is capable of detecting the operator's movement. The controller displays an image individually on each of the multiple head mounted displays. In addition, the controller comprises an endoscope image acquisition unit which is capable of acquiring endoscope image data of a patient's affected area and an image control unit which is capable of controlling each of the endoscope image data on the basis of output from each of the multiple detection units. The controller also displays the image on the basis of the output from the image control unit.