single-rb.php

JRM Vol.37 No.2 pp. 523-534
doi: 10.20965/jrm.2025.p0523
(2025)

Paper:

Fully Automatic Control of Electric Wheelchair by Measuring Obstacle Shape Using Monocular Camera and Laser

Hayato Mitsuhashi and Taku Itami ORCID Icon

Department of Electrical Engineering, Graduate School of Science and Technology, Meiji University
1-1-1 Higashimita, Tama-ku, Kawasaki, Kanagawa 214-8571, Japan

Received:
July 1, 2024
Accepted:
November 11, 2024
Published:
April 20, 2025
Keywords:
electric wheelchair, laser, monocular camera, obstacle shape measurement, pathfinding
Abstract

This study proposed a fully automatic electric wheelchair control system based on an obstacle-shape measurement algorithm using a monocular camera and laser. When the electric wheelchair, equipped with the camera and laser, encounters an obstacle, the control system automatically avoids it in real time by measuring the distance and depth to the obstacle. As this research focuses on obstacle avoidance, a simple pathfinding algorithm is used. When an obstacle is detected, the system creates an avoidance path corresponding to the depth length of the obstacle, updates the current position, and moves to the goal point. The novelty of this system is that it calculates not only the distance to the obstacle but also the depth of the obstacle, which is three-dimensional information. Meanwhile, the minimum and maximum distances from the camera to the obstacle are detected by laser. The distance formula for the proposed method is not the straight-line distance from the camera, but the distance from the position in which the camera is moved horizontally parallel to the obstacle in front of the camera. Therefore, the obstacle depth can be calculated by the difference between the maximum and minimum distances from the camera to the obstacle. The effectiveness of the proposed method was verified by preparing obstacles with different depths and verifying whether the electric wheelchair could generate an avoidance route for each obstacle in the route search and still move to the goal point. We confirmed that the wheelchair stops when the distance to the obstacle reaches an arbitrary length, acquires information on the obstacle depth, creates an avoidance route according to the depth, avoids the obstacle, updates its current position, and automatically moves to the goal point. By further improving the effectiveness of the proposed method, a fully automatic electric wheelchair that can detect the shape of obstacles and avoid them appropriately in hospitals and on roads without depending on the illumination of the measurement environment can be realized.

Fully automatic electric wheelchair

Fully automatic electric wheelchair

Cite this article as:
H. Mitsuhashi and T. Itami, “Fully Automatic Control of Electric Wheelchair by Measuring Obstacle Shape Using Monocular Camera and Laser,” J. Robot. Mechatron., Vol.37 No.2, pp. 523-534, 2025.
Data files:
References
  1. [1] W. Toyoda, M. Hazama, and N. Hirokawa, “Study on the evaluation of the operability of sliding doors for wheelchair users,” The Japanese J. of Ergonomics, Vol.58, No.Suppl., Article No.1A3-05, 2022 (in Japanese) https://doi.org/10.5100/jje.58.1A3-05
  2. [2] D. Azuma et al., “Development of the new welfare service ‘Partner Mobility’ using AI interactive automated drive system: Industry-academia-government collaboration for social implementation,” Bulletin of Kurume Institute of Technology, No.43, pp. 2-12, 2021 (in Japanese).
  3. [3] N. Thongpance and P. Chotikunnan, “Design and construction of electric wheelchair with Mecanum wheel,” J. of Robotics and Control, Vol.4, No.1, pp. 71-82, 2023. https://doi.org/10.18196/jrc.v4i1.17095
  4. [4] T. Yokozeki, “The risk of PMV assumed with reference to electric wheelchairs traffic accident,” J. of Japan Society of Civil Engineers, Ser. D3 (Infrastructure Planning and Management), Vol.75, No.5, pp. I_1049-I_1057, 2019 (in Japanese). https://doi.org/10.2208/jscejipm.75.I_1049
  5. [5] M. Kosaka and H. Nakamura, “Control barrier function design via backstepping and its application to collision avoidance of electric wheel chair,” Proc. of the Japan Joint Automatic Control Conf., pp. 842-847, 2021 (in Japanese). https://doi.org/10.11511/jacc.64.0_842
  6. [6] Y. Mizuno, “Nursing Work,” Pediatric Cardiology and Cardiac Surgery, Vol.40, No.1, pp. 1-2, 2024. https://doi.org/10.9794/jspccs.40.1
  7. [7] B. Pydala, T. P. Kumar, and K K. Baseer, “SMART_EYE: A navigation and obstacle detection for visually impaired people through smart app,” J. of Applied Engineering and Technological Science, Vol.4, No.2, pp. 992-1011, 2023. https://doi.org/10.37385/jaets.v4i2.2013
  8. [8] Y. Shang et al., “Design and test of obstacle detection and harvester pre-collision system based on 2D lidar,” Agronomy, Vol.13, No.2, Article No.388, 2023. https://doi.org/10.3390/agronomy13020388
  9. [9] Y. Pan, F. Huo, Z. Wang, S. Zhai, and Z. Geng, “A millimeter-wave radar tunnel obstacle detection method based on invalid target filtering,” Applied Sciences, Vol.13, No.11, Article No.6720, 2023. https://doi.org/10.3390/app13116720
  10. [10] H. Mitsuhashi, S. Akamine, T. Itami, and J. Yoneyama, “Autonomous mobile robot equipped with a monocular camera and cross-line laser that can measure obstacle distance in real time independent of brightness,” 31st Mediterranean Conf. on Control and Automation (MED), pp. 125-130, 2023. https://doi.org/10.1109/MED59994.2023.10185717
  11. [11] P. Petráček, V. Krátký, and M. Saska, “Dronument: System for reliable deployment of micro aerial vehicles in dark areas of large historical monuments,” IEEE Robotics and Automation Letters, Vol.5, No.2, pp. 2078-2085, 2020. https://doi.org/10.1109/LRA.2020.2969935
  12. [12] A. Kreibich, M. Hennecke, and V. Brandstätter, “The effect of self-awareness on the identification of goal-related obstacles,” European J. of Personality, Vol.34, No.2, pp. 215-233, 2020. https://doi.org/10.1002/per.2234
  13. [13] S. Sundarraj et al., “Route planning for an autonomous robotic vehicle employing a weight-controlled particle swarm-optimized Dijkstra algorithm,” IEEE Access, Vol.11, pp. 92433-92442, 2023. https://doi.org/10.1109/ACCESS.2023.3302698
  14. [14] M. Di Mascolo, C. Martinez, and M.-L. Espinouse, “Routing and scheduling in Home Health Care: A literature survey and bibliometric analysis,” Computers & Industrial Engineering, Vol.158, Article No.107255, 2021. https://doi.org/10.1016/j.cie.2021.107255

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Apr. 24, 2025