Sequential Estimation of 3D Shape and Reflectance Property of Object with Light Field Camera

We discuss a method which sequentially estimates 3D shape and reflectance properties of an object. To estimate these values, we use a light field camera to capture multi view light fields. First, we acquire a 3D point cloud by structure from motion, and then we generate a mesh from the point cloud. Second, we simultaneously estimate normal vectors and a light source from the mesh. Finally, we estimate reflectance parameters of a reflection model with the mesh, normal vectors, and the light source. We also compare the original photo with a CG image rendered using the parameters estimated by our method.