single-jc.php

JACIII Vol.30 No.6 pp. 2138-2148
(2026)

Research Paper:

SGRO: Semantic–Geometric Consistency Loop-Closure Detection and Robust Observation-Factor Modeling for Multi-Robot Distributed Object-Level Semantic SLAM

Chengwei Yang, Zhibin Yang, and Zhi Zheng† ORCID Icon

School of Computer Science and Cyber Security, Fujian Normal University
No.18 Wulongjiang Middle Avenue, Shangjie Town, Minhou County, Fuzhou, Fujian 350117, China

†Corresponding author

Received:
April 20, 2026
Accepted:
September 10, 2026
Published:
November 20, 2026
Keywords:
object-level semantic SLAM, distributed systems, loop-closure detection, observation-factor modeling
Abstract

Distributed multi-robot teams exploring and mapping unknown environments rely on onboard localization and observations, together with information shared within the team. Reliable cross-robot loop-closure detection, robot-pose estimation, and object-state estimation are essential. This study proposes SGRO, a method for loop-closure detection and robust observation-factor modeling in distributed multi-robot object-level semantic simultaneous localization and mapping. SGRO uses the object-level semantic map as a common intermediate representation. Its front end combines semantic and geometric constraints to improve cross-robot loop-closure robustness. Its back end models observation factors for different geometric object types to strengthen the joint optimization of object maps and robot trajectories. Cross-robot loop-closure constraints and object-level semantic mapping are integrated into a unified distributed estimation framework. Experiments show that SGRO improves pose estimation and object-level map stability, with lower position error, yaw error, and map inconsistency.

Regional views and corresponding point-cloud clustering results by SGRO

Regional views and corresponding point-cloud clustering results by SGRO

Cite this article as:
C. Yang, Z. Yang, and Z. Zheng, “SGRO: Semantic–Geometric Consistency Loop-Closure Detection and Robust Observation-Factor Modeling for Multi-Robot Distributed Object-Level Semantic SLAM,” J. Adv. Comput. Intell. Intell. Inform., Vol.30 No.6, pp. 2138-2148, 2026.
Data files:
References
  1. [1] M. W. M. G. Dissanayake, P. Newman, S. Clark et al., “A solution to the simultaneous localization and map building (SLAM) problem,” IEEE Trans. Robotics Autom., Vol.17, No.3, pp. 229-241, 2001. https://doi.org/10.1109/70.938381
  2. [2] T. Bailey and H. Durrant-Whyte, “Simultaneous localization and mapping (SLAM): Part II,” IEEE Robotics Autom. Mag., Vol.13, No.3, pp. 108-117, 2006. https://doi.org/10.1109/MRA.2006.1678144
  3. [3] C. Cadena, L. Carlone, H. Carrillo et al., “Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age,” IEEE Trans. Robotics, Vol.32, No.6, pp. 1309-1332, 2016. https://doi.org/10.1109/TRO.2016.2624754
  4. [4] S. B. Williams, G. Dissanayake, and H. Durrant-Whyte, “Towards multi-vehicle simultaneous localisation and mapping,” Proc. 2002 IEEE Int. Conf. on Robotics and Automation, pp. 2743-2748, 2002. https://doi.org/10.1109/ROBOT.2002.1013647
  5. [5] P.-Y. Lajoie, B. Ramtoula, F. Wu et al., “Towards collaborative simultaneous localization and mapping: A survey of the current research landscape,” Field Robotics, Vol.2, pp. 971-1000, 2022. https://doi.org/10.55417/fr.2022032
  6. [6] S. Hoshino and K. Uchida, “Interactive motion planning for mobile robot navigation in dynamic environments,” J. Adv. Comput. Intell. Intell. Informatics, Vol.21, pp. 667-674, 2017. https://doi.org/10.20965/jaciii.2017.p0667
  7. [7] X. Zhang, Y. Liu, L. Wang et al., “A curiosity-based autonomous navigation algorithm for maze robot,” J. Adv. Comput. Intell. Intell. Informatics, Vol.26, No.6, pp. 893-904, 2022. https://doi.org/10.20965/jaciii.2022.p0893
  8. [8] S. X. Yang and M. Meng, “An efficient neural network model for path planning of car-like robots in dynamic environment,” J. Adv. Comput. Intell. Intell. Informatics, Vol.4, No.3, pp. 220-229, 2000. https://doi.org/10.20965/jaciii.2000.p0220
  9. [9] J. Wang, K. Hirota, X. Wu, Y. Dai, and Z. Jia, “Hybrid bidirectional rapidly exploring random tree path planning algorithm with reinforcement learning,” J. Adv. Comput. Intell. Intell. Inform., Vol.25, No.1, pp. 121-129, 2021. https://doi.org/10.20965/jaciii.2021.p0121
  10. [10] R. P. Rangkuti, V. Dewanto, Aprinaldi et al., “Utilizing google images for training classifiers in CRF-based semantic segmentation,” J. Adv. Comput. Intell. Intell. Informatics, Vol.20, pp. 455-461, 2016. https://doi.org/10.20965/jaciii.2016.p0455
  11. [11] R. Mur-Artal, J. M. M. Montiel, and J. D. Tardós, “ORB-SLAM: A versatile and accurate monocular SLAM system,” IEEE Trans. Robotics, Vol.31, No.5, pp. 1147-1163, 2015. https://doi.org/10.1109/TRO.2015.2463671
  12. [12] R. Mur-Artal and J. D. Tardós, “ORB-SLAM2: An open-source system for monocular, stereo, and RGB-D cameras,” IEEE Trans. Robotics, Vol.33, No.5, pp. 1255-1262, 2017. https://doi.org/10.1109/TRO.2017.2705103
  13. [13] C. Campos, R. Elvira, J. J. Gómez Rodríguez et al., “ORB-SLAM3: An accurate open-source library for visual, visual-inertial, and multi-map SLAM,” IEEE Trans. Robotics, Vol.37, No.6, pp. 1874-1890, 2021. https://doi.org/10.1109/TRO.2021.3075644
  14. [14] T. Qin, P. Li, and S. Shen, “VINS-Mono: A robust and versatile monocular visual-inertial state estimator,” IEEE Trans. Robotics, Vol.34, No.4, pp. 1004-1020, 2018. https://doi.org/10.1109/TRO.2018.2853729
  15. [15] A. Rosinol, M. Abate, Y. Chang et al., “Kimera: An open-source library for real-time metric-semantic localization and mapping,” 2020 IEEE Int. Conf. on Robotics and Automation (ICRA), pp. 1689-1696, 2020. https://doi.org/10.1109/ICRA40945.2020.9196885
  16. [16] J. McCormac, R. Clark, M. Bloesch et al., “Fusion++: Volumetric object-level SLAM,” 2018 Int. Conf. on 3D Vision (3DV), pp. 32-41, 2018. https://doi.org/10.1109/3DV.2018.00015
  17. [17] L. Nicholson, M. Milford, and N. Sünderhauf, “QuadricSLAM: Dual quadrics from object detections as landmarks in object-oriented SLAM,” IEEE Robotics Autom. Lett., Vol.4, No.1, pp. 1-8, 2019. https://doi.org/10.1109/LRA.2018.2866205
  18. [18] S. Yang and S. Scherer, “CubeSLAM: Monocular 3-D object SLAM,” IEEE Trans. Robotics, Vol.35, No.4, pp. 925-938, 2019. https://doi.org/10.1109/TRO.2019.2909168
  19. [19] S. L. Bowman, K. Daniilidis, and G. J. Pappas, “Robust object-level semantic visual SLAM using semantic keypoints,” Field Robotics, Vol.2, pp. 513-524, 2022. https://doi.org/10.55417/fr.2022018
  20. [20] Y. Tian, Y. Chang, F. Herrera Arias et al., “Kimera-Multi: Robust, distributed, dense metric-semantic SLAM for multi-robot systems,” IEEE Trans. Robotics, Vol.38, No.4, pp. 2022-2038, 2022. https://doi.org/10.1109/TRO.2021.3137751
  21. [21] Y. Zhang, M. Hsiao, J. Dong et al., “MR-iSAM2: Incremental smoothing and mapping with multi-root Bayes tree for multi-robot SLAM,” 2021 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pp. 8671-8678, 2021. https://doi.org/10.1109/IROS51168.2021.9636687
  22. [22] X. Liu, A. Prabhu, F. Cladera et al., “Active metric-semantic mapping by multiple aerial robots,” 2023 IEEE Int. Conf. on Robotics and Automation (ICRA), pp. 3282-3288, 2023. https://doi.org/10.1109/ICRA48891.2023.10161564
  23. [23] P.-Y. Lajoie and G. Beltrame, “Swarm-SLAM: Sparse decentralized collaborative simultaneous localization and mapping framework for multi-robot systems,” arXiv:2301.06230, 2023. https://doi.org/10.48550/arXiv.2301.06230
  24. [24] P. C. Lusk, K. Fathian, and J. P. How, “CLIPPER: A graph-theoretic framework for robust data association,” arXiv:2011.10202, 2020. https://doi.org/10.48550/arXiv.2011.10202
  25. [25] M. Kaess, A. Ranganathan, and F. Dellaert, “iSAM: Incremental smoothing and mapping,” IEEE Trans. Robotics, Vol.24, No.6, pp. 1365-1378, 2008. https://doi.org/10.1109/TRO.2008.2006706
  26. [26] M. Kaess, H. Johannsson, R. Roberts et al., “iSAM2: Incremental smoothing and mapping using the Bayes tree,” Int. J. Robotics Research, Vol.31, No.2, pp. 216-235, 2012. https://doi.org/10.1177/0278364911430419
  27. [27] F. Dellaert and M. Kaess, “Factor graphs for robot perception,” Found. Trends Robotics, Vol.6, Nos.1-2, pp. 1-139, 2017. https://doi.org/10.1561/2300000043
  28. [28] L. Schmid, J. Delmerico, J. L. Schönberger et al., “Panoptic multi-TSDFs: A flexible representation for online multi-resolution volumetric mapping and long-term dynamic scene consistency,” 2022 Int. Conf. on Robotics and Automation (ICRA), pp. 8018-8024, 2022. https://doi.org/10.1109/ICRA46639.2022.9811877
  29. [29] K. Sirohi, D. Büscher, and W. Burgard, “uPLAM: Robust panoptic localization and mapping leveraging perception uncertainties,” IEEE Robotics Autom. Lett., Vol.9, No.8, pp. 7174-7181, 2024. https://doi.org/10.1109/LRA.2024.3419648
  30. [30] A. Adkins, T. Chen, and J. Biswas, “ObVi-SLAM: Long-term object-visual SLAM,” IEEE Robotics Autom. Lett., Vol.9, No.3, pp. 2909-2916, 2024. https://doi.org/10.1109/LRA.2024.3363534
  31. [31] Y. Wu, Y. Zhang, D. Zhu et al., “An object SLAM framework for association, mapping, and high-level tasks,” IEEE Trans. on Robotics, Vol.39, No.4, pp. 2912-2932, 2023. https://doi.org/10.1109/TRO.2023.3273180
  32. [32] G. Grisetti, R. Kümmerle, C. Stachniss et al., “A tutorial on graph-based SLAM,” IEEE Intell. Transportation Systems Mag., Vol.2, No.4, pp. 31-43, 2010. https://doi.org/10.1109/MITS.2010.939925
  33. [33] M. Cummins and P. Newman, “FAB-MAP: Probabilistic localization and mapping in the space of appearance,” Int. J. Robotics Research, Vol.27, No.6, pp. 647-665, 2008. https://doi.org/10.1177/0278364908090961
  34. [34] D. Gálvez-López and J. D. Tardós, “Bags of binary words for fast place recognition in image sequences,” IEEE Trans. Robotics, Vol.28, No.5, pp. 1188-1197, 2012. https://doi.org/10.1109/TRO.2012.2197158
  35. [35] R. Arandjelović, P. Gronat, A. Torii et al., “NetVLAD: CNN architecture for weakly supervised place recognition,” 2016 IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 5297-5307, 2016. https://doi.org/10.1109/CVPR.2016.572
  36. [36] G. Kim and A. Kim, “Scan context: Egocentric spatial descriptor for place recognition within 3D point cloud map,” 2018 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pp. 4802-4809, 2018. https://doi.org/10.1109/IROS.2018.8593953
  37. [37] R. Dubé, A. Cramariuc, D. Dugas et al., “SegMap: Segment-based mapping and localization using data-driven descriptors,” Int. J. Robotics Research, Vol.39, Nos.2-3, pp. 339-355, 2020. https://doi.org/10.1177/0278364919863090
  38. [38] X. Liu, J. Lei, A. Prabhu et al., “SlideSLAM: Sparse, lightweight, decentralized metric-semantic SLAM for multirobot navigation,” IEEE Trans. Robotics, Vol.41, pp. 6529-6548, 2025. https://doi.org/10.1109/TRO.2025.3629786
  39. [39] R. Zhang, H. M. Bong, and G. Beltrame, “Active semantic mapping and pose graph spectral analysis for robot exploration,” 2024 IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), pp. 13787-13794, 2024. https://doi.org/10.1109/IROS58592.2024.10802821
  40. [40] A. Asgharivaskasi, F. Girke, and N. Atanasov, “Riemannian optimization for active mapping with robot teams,” IEEE Trans. on Robotics, Vol.41, pp. 1077-1097, 2025. https://doi.org/10.1109/TRO.2025.3526295
  41. [41] R. A. Dwyer, “A faster divide-and-conquer algorithm for constructing delaunay triangulations,” Algorithmica, Vol.2, No.1-4, pp. 137-151, 1987. https://doi.org/10.1007/BF01840356
  42. [42] M. Yaseen, “What is YOLOv8: An in-depth exploration of the internal features of the next-generation object detector,” arXiv:2408.15857, 2024. https://doi.org/10.48550/arXiv.2408.15857

*This site is desgined based on HTML5 and CSS3 for modern browsers, e.g. Chrome, Firefox, Safari, Edge, Opera.

Last updated on Nov. 20, 2026