This paper proposes a machine learning-based position prediction approach to determine the position of a light-emitting diode (LED) target using a new measuring system called the multi-aperture positioning system (MAPS). The measurement system is based on a photogrammetric approach using an aperture mask and a single camera sensor. To achieve high accuracy in position calculation, several complex algorithms with high computational complexity are used. The accuracy of the system is equal to or better than that of existing photogrammetric devices. We investigate whether a neural network (NN) can replace the algorithms currently used in the system software to increase the measurement frequency with similar accuracy. Simulated images are used to train the NN, while real images are used to measure performance. Previously, various algorithms were used to calculate the position of the target from the captured images. Our approach is to train an NN, using thousands of labeled images, to predict the position of the target from these images. We investigate whether systematic measurement errors can be avoided; not all factors affecting the measurement precision are yet known, can always be accurately determined, or change over time. When NNs are used, all information contained in the images is learned by the model, considering all influences present at the time of training. Results show that the trained NN can achieve similar performance to the previously used Gaussian algorithm in less time since no filters or other pre-processing of images are required. This factor directly affects the measurement frequency of the MAPS. The light spot center was detected with sub-pixel accuracy without systematic errors in contrast to some of the previously used algorithms. The simulation of the sensor images needs to be improved to investigate the full potential of the NN.

1. [1] H. Schwenke, W. Knapp, H. Haitjema, A. Weckenmann, R. Schmitt, and F. Delbressine, “Geometric Error Measurement and Compensation of Machines—An Update,” CIRP Annals, Vol.57, No.2, pp. 660-675, 2008.
2. [2] P. S. Huang and J. Ni, “On-Line Error Compensation of Coordinate Measuring Machines,” Int. J. of Machine Tools and Manufacture, Vol.35, No.5, pp. 725-738, 1995.
3. [3] H. Kunzmann, T. Pfeifer, R. Schmitt, H. Schwenke, and A. Weckenmann, “Productive Metrology – Adding Value to Manufacture,” CIRP Annals, Vol.54, No.2, pp. 155-168, 2005.
4. [4] S. Sartori and G. X. Zhang, “Geometric Error Measurement and Compensation of Machines,” CIRP Annals, Vol.44, No.2, pp. 599-609, 1995.
5. [5] U. Bielke, L. Garcia, D. K. Harrison, T. Hageney, K. Banzhaf, E. Wiedenmann, and R. Börret, “New photogrammetric approach for measuring the position of a Tool-Center-Point,” 41st MATADOR Conf. on Advanced Manufacturing, 2021.
6. [6] H. Tayara, K. G. Soo, and K. T. Chong, “Vehicle Detection and Counting in High-Resolution Aerial Images Using Convolutional Regression Neural Network,” IEEE Access, Vol.6, pp. 2220-2230, 2018.
7. [7] J. C. Pyo, H. Duan, S. Baek, M. S. Kim, T. Jeon, Y. S. Kwon, H. Lee, and K. H. Cho, “A Convolutional Neural Network Regression for Quantifying Cyanobacteria Using Hyperspectral Imagery,” Remote Sensing of Environment, Vol.233, 111350, 2019.
8. [8] X. Ren, T. Li, X. Yang, S. Wang, S. Ahmad, L. Xiang, S. R. Stone, L. Li, Y. Zhan, D. Shen, and Q. Wang, “Regression Convolutional Neural Network for Automated Pediatric Bone Age Assessment from Hand Radiograph,” IEEE J. of Biomedical and Health Informatics, Vol.23, No.5, pp. 2030-2038, 2019.
9. [9] I. Goodfellow, Y. Bengio, and A. Courville, “Deep Learning,” The MIT Press, 2016.
10. [10] D. Kato, K. Yoshitsugu, N. Maeda, T. Hirogaki, E. Aoyama, and K. Takahashi, “Positioning Error Calibration of Industrial Robots Based on Random Forest,” Int. J. Automation Technol., Vol.15, No.5, pp. 581-589, 2021.
11. [11] Y. Wang, Z. Chen, H. Zu, X. Zhang, C. Mao, and Z. Wang, “Improvement of Heavy Load Robot Positioning Accuracy by Combining a Model-Based Identification for Geometric Parameters and an Optimized Neural Network for the Compensation of Nongeometric Errors,” Complexity, Vol.2020, 5896813, 2020.
12. [12] S. Aoyagi, M. Suzuki, T. Takahashi, J. Fujioka, and Y. Kamiya, “Calibration of Kinematic Parameters of Robot Arm Using Laser Tracking System: Compensation for Non-Geometric Errors by Neural Networks and Selection of Optimal Measuring Points by Genetic Algorithm,” Int. J. Automation Technol., Vol.6, No.1, pp. 29-37, 2012.
13. [13] D. Kato, K. Yoshitsugu, T. Hirogaki, E. Aoyama, and K. Takahashi, “Predicting Positioning Error and Finding Features for Large Industrial Robots Based on Deep Learning,” Int. J. Automation Technol., Vol.15, No.2, pp. 206-214, 2021.
14. [14] G. Zhao, P. Zhang, G. Ma, and W. Xiao, “System Identification of the Nonlinear Residual Errors of an Industrial Robot Using Massive Measurements,” Robotics and Computer-Integrated Manufacturing, Vol.59, pp. 104-114, 2019.
15. [15] Y. Mizutani, S. Kataoka, Y. Nagai, T. Uenohara, and Y. Takaya, “Structure Estimation of Deep Neural Network for Triangulation Displacement Sensors,” CIRP Annals, Vol.71, No.1, pp. 425-428, 2022.
16. [16] U. Bielke, L. Garcia, D. K. Harrison, T. Hageney, K. Banzhaf, E. Wiedenmann, and R. Börret, “Simulation and Accuracy Evaluation of a New 3D Photogrammetric Position Measurement System,” euspen’s 22nd Int. Conf. & Exhibition, 2022.
17. [17] N. Hagen and E. L. Dereniak, “Gaussian Profile Estimation in Two Dimensions,” Applied Optics, Vol.47, No.36, pp. 6842-6851, 2008.
18. [18] K. O. Bowman and L. R. Shenton, “Estimator: Method of Moments,” S. Kotz, C. B. Read, and D. L. Banks (Eds.), “Encyclopedia of Statistical Sciences,” pp. 2092-2098, Wiley, 1998.
19. [19] L. Garcia, U. Bielke, C. Neumann, T. Hageney, K. Banzhaf, E. Wiedenmann, and R. Börret, “Machine-Learning-Ansatz zur Bestimmung der Target-Position eines optischen Messgeräts,” T. Luhmann and C. Schumacher (Eds.), “Photogrammetrie – Laserscanning – Optische 3D-Messtechnik: Beiträge der Oldenburger 3D-Tage 2022,” pp. 33-42, Wichmann Verlag, 2022 (in German).
20. [20] G. L. Squires, “Practical Physics,” Cambridge University Press, 2001.
21. [21] M. Rosenfelder, “Transfer Learning with EfficientNet for Image Regression in Keras – Using Custom Data in Keras,” 2020. https://rosenfelder.ai/keras-regression-efficient-net/ [Accessed January 1, 2022]