Visualizing State of Time-Series Data by Supervised Gaussian Process Dynamical Models
Faculty of Science and Engineering, Saga University
1 Honjo, Saga 840-8502, Japan
Gaussian Process Dynamical Models (GPDMs) constitute a nonlinear dimensionality reduction technique that provides a probabilistic representation of time series data in terms of Gaussian process priors. In this paper, we report a method based on GPDMs to visualize the states of time-series data. Conventional GPDMs are unsupervised, and therefore, even when the labels of data are available, it is not possible to use this information. To overcome the problem, we propose a supervised GPDM (S-GPDM) that utilizes both the data and their corresponding labels. We demonstrate experimentally that the S-GPDM can locate related motion data closer together than conventional GPDMs.
-  G. Box and G. Jenkins, “Time Series Analysis: Forecasting and Control,” Wiley, 2008.
-  J. Hamilton, “Time Series Analysis,” Princeton University Press, 1994.
-  T. Kohonen, M. Schroeder, and T. Huang, “Self-Organizing Maps,” Springer-Verlag, 2001.
-  N. Lawrence, “Gaussian process latent variable models for visualisation of high dimensional data,” Advances in Neural Information Processing Systems, Vol.16, pp. 329-336, 2004.
-  J. Wang, D. Fleet, and A. Hertzmann, “Gaussian process dynamical models,” Advances in Neural Information Processing Systems, Vol.18, pp. 1441-1448, 2005.
-  W. Fan and N. Bouguila, “Generating Video Textures by PPCA and Gaussian Process Dynamical Model,” Proc. of the 14th Iberoamerican Conf. on Pattern Recognition: Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, pp. 801-808, 2009.
-  N. Gamage, Y. Kuang, R. Akmeliawati, and S. Demidenko, “Gaussian Process Dynamical Models for hand gesture interpretation in Sign Language,” Pattern Recognition Letters, Vol.32, No.15, pp. 2009-2014, 2011.
-  J. Wang, D. Fleet, and A. Hertzmann, “Gaussian Process Dynamical Models for Human Motion,” IEEE Trans. on Pattern Analysis and Machine Intelligence, Vol.30, No.2, pp. 283-298, 2008.
-  J. Wang, Y. Yin, and H. Man, “Multiple Human Tracking Using Particle Filter with Gaussian Process Dynamical Model,” EURASIP J. on Image and Video Processing, 2008.
-  X. Gao, X. Wang, D. Tao, and X. Li, “Supervised Gaussian Process Latent Variable Model for Dimensionality Reduction,” IEEE Trans. on Systems, Man, and Cybernetics, Part B (Cybernetic), Vol.41, No.2, pp. 425-434, 2010.
-  “CMU Graphics Lab Motion Capture Database,”
-  C. Rasmussen and C. Williams, “Gaussian Processes for Machine Learning (Adaptive Computation and Machine Learning),” MIT Press, 2005.
-  M. Moller, “A Scaled Conjugate Gradient Algorithm for Fast Supervised Learning,” Neural Networks, Vol.6, No.4, pp. 525-533, 1993.
-  R. Urtasun, D. Fleet, and P. Fua, “3D People Tracking with Gaussian Process Dynamical Models,” IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 238-245, 2006.
-  N. Lawrence, M. Seeger, and R. Herbrich, “Fast Sparse Gaussian Process Methods: The Informative Vector Machine,” Advances in Neural Information Processing Systems, Vol.15, pp. 625-632, 2003.