A System for Composition of Real Moving Images and CG Images based on Image Feature Points.

In this paper, we present a system for composition of real moving images taken with a video camera and CG images. In general, we will encounter two major questions when we try to generate high-quality composite images. The first question is how exactly we can acquire the coordinates of the feature points in the image, as these coordinates are needed to estimate the geometrical relationship between the real world and the CG world. To cope with this problem, in the proposed system, we employ our previously presented method for the acquisition of high-resolution images, in order to accurately estimate the coordinates of image feature points with subpixel accuracy. The second question is how easily we can generate composite images with a standard video camera such as handy TV camera for home use. To solve this problem, we devised a camera calibration method that requires only four image feature points on a plane surface. Furthermore, experimental simulations demonstrated the successful generation of a composite image sequence composed of more than 100 frames with the proposed method.