Image processing apparatus, image processing method, and image display system

The invention provides an image processing apparatus, image processing method, and image display system. The image processing apparatus for estimating a position in an image which an operator who observes the image is likely to observe as the candidate of a next position is provided. The image processing apparatus (110) includes a next observation estimating unit (101) that estimates a position selected from among a plurality of positions using a parameter indicating an operation history and information regarding an estimation result at least at a current time on the basis of a probability value obtained from a predetermined probability distribution and a displayed image generating unit (102) that generates an image to be displayed so that at least the candidate of the next position is visually recognizable.