Realistic Texture Reconstruction Incorporating Spectrophotometric Color Correction

With the proliferation of high resolution 3D scanners, the quality of recorded 3D models has greatly improved. Nonetheless, while geometric fidelity is important, color information is still required to achieve photo-realistic 3D models. In this regard, texture reconstruction techniques combine color images from several views in order to optimally color the mesh of a 3D model. Nonetheless, a major challenge that is often overlooked by existing approaches is the technical limitations of color acquisition devices that lead to erroneously colored 3D models. In this paper, a novel technique is presented that formulates texture reconstruction as an optimization problem incorporating a color correction term in its objective function. The underlying rationale is to exploit external to the 3D scanner color measurements that can be available from more reliable sensors such as a UV- VIS spectrometer. Such measurements are often available for objects of high aesthetic value such as artworks of cultural heritage objects. Through experimental evaluation of our method on a real painting we demonstrate the superiority of the proposed technique, compared to state-of-the-art texture reconstruction, providing a reliable representation of the artworks appearance both in terms of numerical accuracy and visual observation.