This study proposes a novel stair recognition method that integrates a monocular camera and a laser to improve the safety of the stair-climbing function in an omnidirectional autonomous electric wheelchair equipped with three Mecanum wheels mounted on a single axle. We performed three-dimensional stair measurements, estimated the angle of descent using a camera and laser, and built an automatic stair angle adjustment function into the wheelchair. The proposed method uses coordinate points to detect the staircase structure in three dimensions (x,y,z), performs distance transformation to achieve high-accuracy three-dimensional distance estimation, and provides a detailed visualization of the staircase geometry. Estimating the descent angle from the obtained 3D data yielded a maximum error of 2.72° and an average error of 1.04°, demonstrating higher accuracy than a stereo camera. Furthermore, the automatic stair angle adjustment function of the proposed wheelchair was validated, and an algorithm was developed to automatically maintain the wheelchair’s horizontal orientation based on the acquired stair angle. The experimental results confirmed that the proposed method can accurately adjust in real time with varying staircase angles, significantly improving the safety of the stair-climbing function. In addition, by applying this method to an autonomous mobile robot, it can detect obstacles and recognize staircase structures in the absence of ambient illumination, allowing for autonomous operation while analyzing its environment in three dimensions.

1. [1] B. C. J. M. Fauser, G. D. Adamson, J. Boivin, G. M. Chambers, C. Geyter, S. Dyer, M. C. Inhorn, L. Schmidt, G. I. Serour, B. Tarlatzis, and F. Zegers-Hochschild, “Declining global fertility rates and the implications for family planning and family building: An IFFS consensus document based on a narrative review of the literature,” Human Reproduction Update, Vol.30, No.2 pp. 153-173, 2024. https://doi.org/10.1093/humupd/dmad028
2. [2] X. Li, J. Zhu, J. Wan, and Z. Wang, “Equilibrium in adversity: Balancing public service supply and demand during population decline,” Humanities and Social Sciences Communications, Vol.11, Article No.1760, 2024. https://doi.org/10.1057/s41599-024-04311-8
3. [3] H. Yanagihara, S. Kazama, T. Yamamoto, A. Ikemoto, T. Tada, and Y. Touge, “Nationwide evaluation of changes in fluvial and pluvial flood damage and the effectiveness of adaptation measures in Japan under population decline,” Int. J. of Disaster Risk Reduction, Vol.110, Article No.104605, 2024. https://doi.org/10.1016/j.ijdrr.2024.104605
4. [4] A. I. Okpani, P. Adu, T. Paetkau, K. Lochhart, and A. Yassi, “Are COVID-19 vaccination mandates for healthcare workers effective? A systematic review of the impact of mandates on increasing vaccination, alleviating staff shortages and decreasing staff illness,” Vaccine, Vol.42, No.5, pp. 1022-1033, 2024. https://doi.org/10.1016/j.vaccine.2024.01.041
5. [5] C. Isendahl, N. P. Dunning, L. Grazioso, S. Hawken, D. L. Lentz, and V. L. Scarborough, “Growth and decline of a sustainable city: A multitemporal perspective on blue-black-green infrastructures at the pre-Columbian Lowland Maya city of Tikal,” Urban Studies, Vol.62, Issue 3, pp. 487-506, 2024. https://doi.org/10.1177/00420980231224648
6. [6] Y.-C. Chou, T. Uwano, B.-W. Chen, K. Sarai, L. D. Nguyen, C.-J. Chou, S. Mongkolsawadi, and T. T. Nguyen, “Assessing disability rights in four Asian countries: The perspectives of disabled people on physical, attitudinal and cultural barriers,” Political Geography, Vol.108, Article No.103027, 2024. https://doi.org/10.1016/j.polgeo.2023.103027
7. [7] T. Tiwari, K. Sharma, C. Rudra, M. Singh, and P. K. Dan, “Automatizing step-climbing feature in a wheelchair via digitized movement control for value-sensitive market,” Low-Cost Digital Solutions for Industrial Automation (LoDiSA 2024), Vol.2024, No.11, 2024. https://doi.org/10.1049/icp.2024.3484
8. [8] T. S. Vaquero, G. Daddi, R. Thakker, M. Paton, A. Jasour, M. P. Strub, R. M. Swan, R. Royce et al., “EELS: Autonomous snake-like robot with task and motion planning capabilities for ice world exploration,” Science Robotics, Vol.9, No.88, Article No.eadh8332, 2024. https://doi.org/10.1126/scirobotics.adh8332
9. [9] K. Sakai and M. Yasuda, “Verification of the operability of short-distance mobility vehicles (electric wheelchair) WHILL through test drive experiments,” Psychology Research, Vol.14, No.4, pp. 121-131, 2024. https://doi.org/10.17265/2159-5542/2024.04.001
10. [10] Y. Liu, Y. Wei, C. Wang, and H. Wu, “An environment recognition algorithm for staircase climbing robots,” Remote Sensing, Vol.16, No.24, Article No.4718, 2024. https://doi.org/10.3390/rs16244718
11. [11] S. Akamine, S. Totoki, T. Itami, and J. Yoneyama, “Real-time obstacle detection in a darkroom using a monocular camera and a line laser,” Artificial Life and Robotics, Vol.27, pp. 828-833, 2022. https://doi.org/10.1007/s10015-022-00787-2
12. [12] H. Mitsuhashi, S. Akamine, T. Itami, and J. Yoneyama, “Autonomous mobile robot equipped with a monocular camera and cross-line laser that can measure obstacle distance in real time independent of brightness,” Proc. of the 31st Mediterranean Conf. on Control and Automation (MED), pp. 125-130, 2023. https://doi.org/10.1109/MED59994.2023.10185717
13. [13] Y. Ueno, I. Ikemura, T. Tanaka, and Y. Matsuo, “Development of a front-wheel-steering-drive dual-wheel caster drive mechanism for omni-directional wheelchairs with high step climbing performance,” J. Robot. Mechatron., Vol.34, No.6, pp. 1431-1440, 2022. https://doi.org/10.20965/jrm.2022.p1431
14. [14] T. Nakayama and M. Wada, “Study on an add-on type electric wheelchair using active caster with the differential mechanism,” J. Robot. Mechatron., Vol.35, No.1, pp. 99-112, 2023. https://doi.org/10.20965/jrm.2023.p0099
15. [15] H. Mitsuhashi and T. Itami, “Fully automatic control of electric wheelchair by measuring obstacle shape using monocular camera and laser,” J. Robot. Mechatron., Vol.37, No.2, pp. 523-534, 2025. https://doi.org/10.20965/jrm.2025.p0523
16. [16] A. Aryanti, M.-S. Wang, and M. Muslikhin, “Navigating unstructured space: Deep action learning-based obstacle avoidance system for indoor automated guided vehicles,” Electronics, Vol.13, No.2, Article No.420, 2024. https://doi.org/10.3390/electronics13020420
17. [17] Y. Gao, L. Ren, T. Shi, T. Xu, and J. Ding, “Autonomous obstacle avoidance algorithm for unmanned aerial vehicles based on deep reinforcement learning,” Engineering Letters, Vol.32, No.3, pp. 650-660, 2024.
18. [18] M. Verdonck, L. Wiles, and K. Broome, “Lived experience of using assistive technology for sandy beach based leisure for Australian people with mobility limitations,” Disability and Rehabilitation: Assistive Technology, Vol.19, No.4, pp. 1568-1578, 2024. https://doi.org/10.1080/17483107.2023.2217859
19. [19] E. M. Smith, S. Huff, H. Wescott, R. Daniel, I. D. Ebuenyi, M. Maalim, W. Zhang, C. Khasnabis, and M. Maclachlan, “Assistive technologies are central to the realization of the convention on the rights of persons with disabilities,” Disability and Rehabilitation: Assistive Technology, Vol.19, No.2, pp. 486-491, 2024. https://doi.org/10.1080/17483107.2022.2099987
20. [20] T. Kodama, H. Mitsuhashi, and T. Itami, “Real-time obstacle distance measurement independent of illumination with monocular camera and cross laser,” 2024 Int. Automatic Control Conf. (CACS 2024), 2024. https://doi.org/10.1109/CACS63404.2024.10773154
21. [21] T. Kodama, T. Itami, and J. Yoneyama, “Monocular camera and line laser-based real-time multi-obstacle distance measurement system,” The 10th IEEJ Int. Workshop on Sensing, Actuation, Motion Control, and Optimization, 2024.