JRM Vol.15 No.3 pp. 254-262
doi: 10.20965/jrm.2003.p0254


High-Resolution Image Synthesis from Video Sequence by Light Field

Kenkichi Kobayashi, and Hideo Saito

Department of Information and Computer Science, Keio University, Japan 3-14-1 Hiyoshi, Kouhoku-ku, Yokohama, 223-8522 Japan

November 14, 2002
March 4, 2003
June 20, 2003
image-based rendering, light field, high-resolution image, image mosaicing, video image sequence
We propose a novel method to synthesize high-resolution images from image sequences taken with a moving video camera. Each frame in the image sequence is a part of the photographed object. Our method integrates these frames to generate high-resolution images of object by constructing a light field, which is quite different from general mosaic methods. In light fields constructed straightforwardly, blur and discontinuity are introduced into synthesized images by depth variation of the object. In our method, the light field is optimized to remove blur and discontinuity so clear images can be synthesized. We find the optimum light field for generating sharp unblurred images by reparameterizing light field and evaluating sharpness of synthesized images from each light field. The optimized light field is adapted to the depth variation of the object surface, but the exact shape of the object is not necessary. High resolution images that are impractical in the real system can be virtually synthesized from the light field. Results of the experiment applied to a book surface demonstrate the effectiveness of the proposed method.
Cite this article as:
K. Kobayashi and H. Saito, “High-Resolution Image Synthesis from Video Sequence by Light Field,” J. Robot. Mechatron., Vol.15 No.3, pp. 254-262, 2003.
Data files:

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Jun. 03, 2024