Top > JACIII > Image Morphing and Warping: Application to Speech Simulation U ...

single-jc.php

JACIII Vol.13 No.4 pp. 441-446
doi: 10.20965/jaciii.2009.p0441
(2009)

Paper:

Views over last 60 days: 541

Image Morphing and Warping: Application to Speech Simulation Using a Single Image

Stephen Karungaru, Takuya Akashi, Minoru Fukumi,
and Norio Akamatsu

Department of Information Science and Intelligent Systems, University of Tokushima,
2-1 Minami-Josanjima, Tokushima 770-8506, Japan

Received:
November 25, 2008
Accepted:
March 17, 2009
Published:
July 20, 2009
Creative Commons License
Keywords:
warping, lips contour extraction, SNAKES, facial gestures
Abstract
In this paper, we propose a fully automatic real time one image face gesture simulation using image morphing. Given a single image of a subject, we create several facial expressions of the face by morphing the image based on prior information stored in a data bank. The process involves the automatic detection of the control points both on the target image and the source data. The source data is a string of frames containing the desired facial expressions. A face detection neural network and a lips contour detector using edges and the SNAKES algorithm are employed to detect the face position and features. Five control points and the lips contour, for both the source and target images, are then extracted based on the facial features. Triangulation method is then used to match and warp the source image to the target image using the control points. In this experiment, using one expressionless face portrait, we create an animation to make it appear like the subject is pronouncing the five Japanese vowels. The final results shows the effectiveness of our method.
Cite this article as:
S. Karungaru, T. Akashi, M. Fukumi, and N. Akamatsu, “Image Morphing and Warping: Application to Speech Simulation Using a Single Image,” J. Adv. Comput. Intell. Intell. Inform., Vol.13 No.4, pp. 441-446, 2009.
Data files:
References
  1. [1] G. Worlberg, “Image morphing: a survey,” The Visual Computer, Vol.14, pp. 360-372, 1998.
  2. [2] A. Goshtasby, “Piecewise linear mapping functions for image registration,” Pattern Recognition, Vol.19, No.6, pp. 459-466, 1986.
  3. [3] M. Berg, M. Kreveld, M. Overmars, and O. Schwarzkorf, “Computation geometry- Algorithms and Applications,” Springer, 1997.
  4. [4] T. Beier and S. Nelly, “Feature-based image metamorphosis,” Proc. of SIGGRAPH, pp. 35-42, 1992.
  5. [5] D. Rurecht and H, Muller, “Free form deformation with scattered data interpolation methods,” Geometrical Modeling, Springer Verlag, pp. 267-281, 1993.
  6. [6] I. Amidror, “Scattered data interpolation methods for electronics imaging systems: a survey,” Journal of Electronic Imaging, 11(2), pp. 157-176, 2002.
  7. [7] S. Karungaru, M. Fukumi, and N. Akamatsu, “Genetic Algorithms Based On-line Size and Rotation Invariant Face Detection. Journal of Signal Processing,” Vol.9, No.6, pp. 497-503, 2005.
  8. [8] T. Akashi, Y. Wakasa, K. Tanaka, S. Karungaru, and M. Fukumi, “High Speed Genetic Lips Detection by Dynamic Search Domain Control,” IEEJ Transactions on Electronics, Information and Systems, Vol.127, No.6, pp. 854-866, 2007.
  9. [9] G. Nielson, H. Hager, and H. Muller, “Scientific Visualization,” IEEE, New York, p. 433, 1997.
  10. [10] Kass, A. Witkin, and D. Terzopoulos, “Snakes-Active contour model, Computer Vision,” Vol.1, No.3, pp. 321-331, 1988.
  11. [11] T. McInerney and D. Terzopoulos, “Deformable models in medical image analysis: A survey,” Medical Image Analysis 1(2), pp. 91-108, 1996.
  12. [12] A. K. Jain, Y. Zhong, and M.-P. Dubuisson-Jolly, “Deformable template models: A review,” Signal Processing 71(2), pp. 109-129, 1998.
  13. [13] T. Sakaguchi, K. Oyama, “SNAKE with the area term,” Proc. of IEICE General conf., D-555, 1991 (in Japanese).
  14. [14] M. Soriano, E. Marszalec, and M. Pietikainen, “Color correction of face images under different illuminants by RGB eigenfaces,” Proc. 2nd Audio- and Video-Based Biometric Person Authentication Conf., pp. 148-153, 1999.

Creative Commons License  This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Dec. 06, 2024