Top > JRM > A Supporting System of Choral Singing for Visually Impaired ...

single-rb.php

JRM Vol.26 No.6 pp. 735-742
doi: 10.20965/jrm.2014.p0735
(2014)

Paper:

Views over last 60 days: 1,096

A Supporting System of Choral Singing for Visually Impaired Persons Using Depth Image Sensor

Noriyuki Kawarazaki*, Yuhei Kaneishi*, Nobuyuki Saito**,
and Takashi Asakawa***

*Kanagawa Institute of Technology, 1030 Shimo-Ogino, Atsugi-shi, Kanagawa 243-0292, Japan

**Asap System Co., Ltd., Setoru Higashioume 109, 2-18-5 Higashioume, Oume, Tokyo 198-0042, Japan

***Kinki University Technical College, 7-1 Kasugaoka, Nabari, Mie 518-0459, Japan

Received:
April 29, 2014
Accepted:
July 8, 2014
Published:
December 20, 2014
Creative Commons License
Keywords:
universal design, chorus support system, depth image sensor, electric music baton, haptic interface device
Abstract

Supporting system of choral singing
Visually impaired persons may find it difficult to take part in a chorus or other singing group because they cannot see the beat indicated by conductor’s hand movements. This paper provides a chorus support system for visually impaired persons using depth image sensor. This consists of an electric music baton with an acceleration sensor, a radio module, haptic interface devices with vibration motors, a depth image sensor, and a PC. The electric music baton transmits the signal indicating the conductor’s motion to visually impaired players based on sensor acceleration. Since the conductor must give individual instruction to player, we use a depth image sensor to indicate the direction in which the conductor’s baton points. This direction is estimated based on the conductor’s posture. We also attempted to develop a chorus support system without using the electric music baton. The beat is obtained by the maximum velocity position of the conductor’s hand motion using a depth image sensor. The effectiveness of our system is clarified by several experimental results.
Cite this article as:
N. Kawarazaki, Y. Kaneishi, N. Saito, and T. Asakawa, “A Supporting System of Choral Singing for Visually Impaired Persons Using Depth Image Sensor,” J. Robot. Mechatron., Vol.26 No.6, pp. 735-742, 2014.
Data files:
References
  1. [1] Y. Nagamatsu, “Outdoor Activities of the Complete Blind (Papers of the 3rd Scientific Research Meeting),” Zoen Zassi, Vol.48, No.5, pp. 217-221, 1985.
  2. [2] Y. Nagamatsu, “A Study on the Utilization of the Park for the Blind,” Zoen Zassi, Vol.49, No.1, pp. 1-9, 1985.
  3. [3] Y. Nagamatsu, “A Study on Leisure Time Activities of the Blind School Students,” Zoen Zassi, Vol.55, No.5, pp. 265-270, 1992.
  4. [4] T. Asakawa, N. Saito, N. Kawarazaki, T. Yoshidome, and K. Nishihara, “Development of an Electronic Baton for a Visually Handicapped Person’s Music Study Support,” Proc. of the Welfare Engineering Symposium 2009, pp. 112-113, 2009.
  5. [5] T. Asakawa and N. Kawarazaki, “An Electric Music Baton System using a Haptic Interface for Visually Disabled Persons,” Proc. of the SICE annual Conf. 2012, TuB10-01, 2012.
  6. [6] T. Asakawa, N. Saito, N. Kawarazaki, and K. Nishihara, “A Study of an Electronic Baton for Visually Handicapped Persons: Support Method for Chorus Circle which Include Visually Handicapped Persons,” The 10th SICE System Integration, 3F1-1, pp. 1555-1557, 2009.
  7. [7] T. Asakawa, K. Nishihara, and N. Kawarazaki, “A Music Baton for an Assistance of Visual Handicapped Persons,” The 6th China-Japan Conf. on Mechatronics, PJ002(4), 2010.
  8. [8] S. Ito, K. Kotani, and K. Horii, “A Measurement of Differential Limen of Force for Haptic-Interface,” human interface, Vol.7, No.2, pp. 21-24, 2005.
  9. [9] A. G. Dodds, D. Clark, and C. I. Howarth, “The effects of precueing on vibrotactile reaction times: Implications for guidance device for blind people,” Ergonomics, Vol.29, No.9, pp. 1063-1071, 1986.
  10. [10] Y. Mori, T. Tanaka, and S. Kaneko, “Vibration Alert Interface for Detecting Surroundings,” Third Asia Int. Symposium on Mechatronics, FA1-1(3), 2008.
  11. [11] K. Nakamura, K. Tanaka, and H. Miyagi, “Kinect for Windows SDK Programming C#-hen,” Shuwa System, 2012 (in Japanese).
  12. [12] Y. Saita, “Hajimeteno Shikihou,” Ongaku no Tomo Sya, 1999 (in Japanese).
  13. [13] T. Asakawa, N. Kawarazaki, K. Nishihara, and N. Saito, “Study of Improvement of Response Time Using Haptic Interface,” Proc. 2011 JSME Conf. on Robotics and Mechatronics, 2P1-D09, 2011.
  14. [14]
    Supporting Online Materials:[a] Light Center of Kanagawa prefecture,
    http://www.kanagawalc.org/ [Accessed December 20, 2012]
  15. [15] [b] A. Hiraiwa, M. Fukumoto, and T. Uchiyama, “Conductor’s baton operation display device for blind,” Japan Patent 1995-261751,
    http://www.directorypatent.com/JP/1995ZZDASHZZ261751.html [Accessed April 10, 2012]
  16. [16] [c] Cableless Datalogging System AS-RS168/RR168,
    http://www.asap-sys.co.jp/ [Accessed October 15, 2012]
  17. [17] [d] KINECT for windows,
    http://www.microsoft.com/en-us/kinectforwindows/ [Accessed June 18, 2012]
  18. [18] [e] RENESUS H8S/2218, 2212,
    http://japan.renesas.com/products/mpumcu/h8s/h8s2200/h8s2218_h8s2212/index.jsp [Accessed November 20, 2012]

Creative Commons License  This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Dec. 02, 2024