Paper:
Project-Based Learning in Robotics: Integrating Object Detection AI and Mechatronics in Undergraduate Engineering Education
Kazuteru Tobita

Shizuoka Institute of Science and Technology
2200-2 Toyosawa, Fukuroi, Shizuoka 437-8555, Japan
This study presents a project based learning approach to engineering education that integrates robotics, AI, and multidisciplinary knowledge. This study focuses on creative exercise of robotics engineering for third-year mechanical engineering students at the Shizuoka Institute of Science and Technology. Students were tasked with designing and manufacturing a robotic arm and hand capable of detecting and manipulating objects using image processing and AI. This project aimed to cultivate problem-solving skills, creativity, and the ability to apply knowledge from various disciplines. The students were given constraints on weight, size, cost, and the use of specific software. The project was conducted over two semesters, with presentations and demonstrations at the end of each semester. The results showed that most groups successfully completed the task, with students reporting a high sense of accomplishment. A questionnaire administered to the students revealed that the project was challenging but rewarding, and that they were able to apply knowledge from various courses, particularly in the areas of Industrial Mechanics / Mechanics of Materials, Machine Elements / Mechanism, Instrumentation Engineering, Mechatronics/Robotics, Design & Drafting / 2D CAD, and 3D CAD. Students also reported an increased understanding of these subjects after their hands-on experience. This study highlights the effectiveness of PBL in bridging theory and practice in engineering education, and the importance of incorporating AI and multidisciplinary knowledge in robotics projects.
- [1] J. Legge, “Confucian Analects, the Great Learning, and the Doctrine of the Mean: The Chinese Classics, Vol.I,” Oxford, 1893.
- [2] L. A. Lyall, “The Sayings of Confucius,” Longmans, Green and Co., 1909.
- [3] J. E. Mills and D. Treagust, “Engineering Education, Is Problem-Based or Project-Based Learning the Answer,” Australasian J. of Engineering Education, Vol.3, 2003.
- [4] M. Mori, “The Cradle Years of the Robotics and my Idea of the Robot-Contest,” J. of the Robotics Society of Japan, Vol.23, No.4, pp. 384-387, 2005 (in Japanese). https://doi.org/10.7210/jrsj.23.384
- [5] J. Kawata, J. Morimoto, M. Higuchi, and S. Fujisawa, “The Educational Effects of Practical Manufacturing Activities in Graduation Research,” J. Robot. Mechatron., Vol.31, No.3, pp. 391-404, 2019. https://doi.org/10.20965/jrm.2019.p0391
- [6] T. Doi, M. Shimaoka, and S. Suzuki, “Creative Robot Contests for Decommissioning as Conceived by College of Technology or KOSEN Educators,” J. Robot. Mechatron., Vol.34, No.3, pp. 498-508, 2022. https://doi.org/10.20965/jrm.2022.p0498
- [7] T. Harada, Y. Ohtsubo, T. Hashimoto, and N. Suzuki, “A Creative Educational Program for Department of Mechanical Engineering Using Bipedal Walking Robot,” J. of JSEE, Vol.58, Issue 2, pp. 2_46-2_51, 2010. https://doi.org/10.4307/jsee.58.2_46
- [8] H. Satoh, S. Toyama, N. Ogawa, M. Umeda, A. Takahashi, M. Usui, and H. Oyanagi, “Engineering Experiments in Manufacturing Education,” J. Robot. Mechatron., Vol.23, No.2, pp. 231-238, 2011. https://doi.org/10.20965/jrm.2011.p0231
- [9] S. Hara, K. Kuroda, Y. Aoi, K. Nakagami, K. Hashizume, and S. Hata, “PBL Program Producing Flying Robot in Mechanical and Aerospace Engineering Department,” MATEC Web Conf., Vol.306: The 6th Int. Conf. on Mechatronics and Mechanical Engineering (ICMME 2019), Article No.05003, 2020. https://doi.org/10.1051/matecconf/202030605003
- [10] K. Hisazumi, S. Hosoai, H. Watanabe, M. Miwa, N. Ogura, and M. Motoki, “An Interdisciplinary and University PBL Curriculum Using Robot Challenge,” 2018 IEEE Int. Conf. on Teaching, Assessment, and Learning for Engineering (TALE), pp. 308-315, 2018. https://doi.org/10.1109/TALE.2018.8615301
- [11] H. Hassan, C. Domínguez, J.-M. Martínez, A. Perles, J.-V. Capella, and J. Albaladejo, “A Multidisciplinary PBL Robot Control Project in Automation and Electronic Engineering,” IEEE Trans. on Education, Vol.58, No.3, pp. 167-172, 2015. https://doi.org/10.1109/te.2014.2348538
- [12] K. Nakatani, T. Doi, T. Wada, and T. Kaneda, “Promotion of Self-Growth of Students by PBL-Type Manufacturing Practice,” J. Robot. Mechatron., Vol.29, No.6, pp. 1037-1048, 2017. https://doi.org/10.20965/jrm.2017.p1037
- [13] T. Morishita, “Creating Attraction for Technical Education Material and its Educational Benefit (Development of Robotic Education Material Characterized by 3D CAD/CAM and Compact Stereo Vision),” J. Robot. Mechatron., Vol.23, No.5, pp. 665-675, 2011. https://doi.org/10.20965/jrm.2011.p0665
- [14] M.-H. Phan and H. Q. T. Ngo, “A Multidisciplinary Mechatronics Program: From Project-Based Learning to a Community-Based Approach on an Open Platform,” Electronics, Vol.9, No.6, Article No.954, 2020. https://doi.org/10.3390/electronics9060954
- [15] Y. Wang, Y. Yu, H. Wiedmann, N. Xie, C. Xie, W. Jiang, and X. Feng, “Project based learning in mechatronics education in close collaboration with industrial: Methodologies, examples and experiences,” Mechatronics, Vol.22, Issue 6, pp. 862-869, 2012. https://doi.org/10.1016/j.mechatronics.2012.05.005
- [16] Mitsubishi Electric Corporation, “MELFA RV-1A/RV-2AJ Catalog,” 2000.
- [17] K. Tobita, “Practice of Mechatronics Project Based Learning Exercise on Robot Hand,” The Proc. of JSME Annual Conf. on Robotics and Mechatronics (Robomec) 2020, Article No.2P2-K01, 2020 (in Japanese). https://doi.org/10.1299/jsmermd.2020.2P2-K01
- [18] K. Tobita, “The challenge of robot hand PBL during the COVID-19 pandemic,” The Proc. of JSME Annual Conf. on Robotics and Mechatronics (Robomec) 2021, Article No.1P2-M01, 2021 (in Japanese). https://doi.org/10.1299/jsmermd.2021.1P2-M01
- [19] K. Tobita, “Trial of the divided production PBL for robot hands and SCARA robots,” The Proc. of JSME Annual Conf. on Robotics and Mechatronics (Robomec) 2022, Article No.2P2-R07, 2022 (in Japanese). https://doi.org/10.1299/jsmermd.2022.2P2-R07
- [20] K. Tobita, “Robot PBL Using Object Detection AI in the Department of Mechanical Engineering,” The Proc. of JSME Annual Conf. on Robotics and Mechatronics (Robomec) 2024, Article No.2A2-S08, 2024 (in Japanese). https://doi.org/10.1299/jsmermd.2024.2A2-S08
- [21] S. Hirama, R Ueda, Y. Nakagawa, and N. Nakagawa, “Detection and Manipulation of Heaped Fried Chicken,” The Proc. of JSME Annual Conf. on Robotics and Mechatronics (Robomec) 2018, Article No.1A1-D03, 2018 (in Japanese). https://doi.org/10.1299/jsmermd.2018.1A1-D03
- [22] J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” 2016 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 779-788, 2016. https://doi.org/10.1109/CVPR.2016.91
- [23] C. Spearman, “The Proof and Measurement of Association between Two Things,” The American J. of Psychology, Vol.15, No.1, pp. 72-101, 1904. https://doi.org/10.2307/1412159
This article is published under a Creative Commons Attribution-NoDerivatives 4.0 Internationa License.