Since financial reports usually contain a large amount of data and complex information, traditional methods for quality inspection are not only slow but also difficult, which greatly affects the efficiency of quality inspection. This paper adopts knowledge graph and artificial intelligence methods to convert unstructured data in financial reports into structured data that can be quickly processed, thereby improving the efficiency and performance of financial report quality inspection. Therefore, this paper proposes an ALBERT-BiGRU-CRF model algorithm to perform named entity recognition on financial reports, which can effectively identify complex entities in financial reports; in addition, a RoBERTa-BiGRU model algorithm is proposed to extract the relationship between entities and finally construct the relevant knowledge graph. By analyzing the knowledge graph, relevant data inside the financial report can be obtained. The F1 score of the ALBERT-BiGRU-CRF model proposed in this paper is 6.1% higher than that of the BERT-BiGRU-CRF model, and the F1 score of the RoBERTa-BiGRU model proposed in this paper is 4.1% higher than that of BiGRU. The model proposed in this paper is of great significance for the knowledge graph modeling and quality inspection of financial reports.

1. [1] A. Singhal, “Introducing the knowledge graph: Things, not strings,” Official Blog of Google, 2012. https://blog.google/products/search/introducing-knowledge-graph-things-not/ [Accessed October 10, 2024]
2. [2] S. Ji, S. Pan, E. Cambria, P. Marttinen, and P. S. Yu, “A survey on knowledge graphs: Representation, acquisition, and applications,” IEEE Trans. on Neural Networks and Learning Systems, Vol.33, No.2, pp. 494-514, 2022. https://doi.org/10.1109/TNNLS.2021.3070843
3. [3] M. Bulla, L. Hillebrand, M. Lübbering, and R. Sifa, “Knowledge graph based question answering system for financial securities,” KI 2021: Advances in Artificial Intelligence, pp. 44-50, 2021. https://doi.org/10.1007/978-3-030-87626-5_4
4. [4] N. Kertkeidkachorn, R. Nararatwong, Z. Xu, and R. Ichise, “FinKG: A core financial knowledge graph for financial analysis,” IEEE 17th Int. Conf. on Semantic Computing, pp. 90-93, 2023. https://doi.org/10.1109/ICSC56153.2023.00020
5. [5] Z. Xu, H. Takamura, and R. Ichise, “A framework to construct financial causality knowledge graph from text,” IEEE 18th Int. Conf. on Semantic Computing (ICSC), pp. 57-64, 2024. https://doi.org/10.1109/ICSC59802.2024.00015
6. [6] Y. Zhu, R. Jia, G. Wang, and C. Xie, “A review of supply chain finance risk assessment research: Based on knowledge graph technology,” Systems Engineering: Theory & Practice, Vol.43, No.3, pp. 795-812, 2023 (in Japanese). https://doi.org/10.12011/SETP2022-0815
7. [7] Y. Xue and L. Huang, “Research on internet financial fraud detection based on knowledge graph,” Management & Engineering, Vol.33, pp. 32-38, 2018.
8. [8] H. Wu, Y. Chang, J. Li, and X. Zhu, “Financial fraud risk analysis based on audit information knowledge graph,” Procedia Computer Science, Vol.199, pp. 780-787, 2022. https://doi.org/10.1016/j.procs.2022.01.097
9. [9] Z. Liu, Y. Qian, W. Lv, Y. Fang, and S. Liu, “Multi-feature fusion stock prediction based on knowledge graph,” The Electronic Library, Vol.42, No.3, pp. 455-482, 2024. https://doi.org/10.1108/EL-02-2023-0053
10. [10] Y. Liu, Q. Zeng, J. O. Meré, and H. Yang, “Anticipating stock market of the renowned companies: A knowledge graph approach,” Complexity, Vol.2019, Article No.9202457, 2019. https://doi.org/10.1155/2019/9202457
11. [11] B. Zhang et al., “Construction research and applications of industry chain knowledge graphs,” Proc. of the 15th Int. Conf. on Knowledge Science, Engineering and Management, Part 1, pp. 120-132, 2022. https://doi.org/10.1007/978-3-031-10983-6_10
12. [12] C. Ma, H. Sun, S. Wang, S. Lu, and J. Li, “Bond default prediction based on deep learning and knowledge graph technology,” IEEE Access, Vol.9, pp. 12750-12761, 2021. https://doi.org/10.1109/ACCESS.2021.3052054
13. [13] X. Fu, X. Ren, O. J. Mengshoel, and X. Wu, “Stochastic optimization for market return prediction using financial knowledge graph,” 2018 IEEE Int. Conf. on Big Knowledge, pp. 25-32, 2018. https://doi.org/10.1109/ICBK.2018.00012
14. [14] X. Hou, “Design and application of intelligent financial accounting model based on knowledge graph,” Mobile Information Systems, Vol.2022, Article No.8353937, 2022. https://doi.org/10.1155/2022/8353937
15. [15] Y. Chen and Z. Wu, “Financial fraud detection of listed companies in China: A machine learning approach,” Sustainability, Vol.15, No.1, Article No.105, 2023. https://doi.org/10.3390/su15010105
16. [16] S. Cai and Z. Xie, “Explainable fraud detection of financial statement data driven by two-layer knowledge graph,” Expert Systems with Applications, Vol.246, Article No.123126, 2024. https://doi.org/10.1016/j.eswa.2023.123126
17. [17] S. F. Mohsin, S. I. Jami, S. Wasi, and M. S. Siddiqui, “An automated information extraction system from the knowledge graph based annual financial reports,” PeerJ Computer Science, Vol.10, Article No.e2004, 2024. https://doi.org/10.7717/peerj-cs.2004
18. [18] D. Cheng, F. Yang, X. Wang, Y. Zhang, and L. Zhang, “Knowledge graph-based event embedding framework for financial quantitative investments,” Proc. of the 43rd Int. ACM SIGIR Conf. on Research and Development in Information Retrieval, pp. 2221-2230, 2020. https://doi.org/10.1145/3397271.3401427
19. [19] M.-Y. Day, P.-T. Chiu, Y.-W. Teng, and C.-L. Liu, “Developing relation types of cryptocurrency anti-money laundering knowledge graph,” IEEE 23rd Int. Conf. on Information Reuse and Integration for Data Science, pp. 90-94, 2022. https://doi.org/10.1109/IRI54793.2022.00031
20. [20] B. Kong, R.-F. Xu, and D.-Y. Wu, “Bootstrapping-based relation extraction in financial domain,” 2015 Int. Conf. on Machine Learning and Cybernetics, pp. 897-903, 2015. https://doi.org/10.1109/ICMLC.2015.7340672
21. [21] Z. Lan et al., “ALBERT: A lite BERT for self-supervised learning of language representations,” arXiv:1909.11942, 2019. https://doi.org/10.48550/arXiv.1909.11942
22. [22] J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” arXiv:1810.04805, 2018. https://doi.org/10.48550/arXiv.1810.04805
23. [23] K. Cho et al., “Learning phrase representations using RNN encoder-decoder for statistical machine translation,” arXiv:1406.1078, 2014. https://doi.org/10.48550/arXiv.1406.1078
24. [24] A. Vaswani et al., “Attention is all you need,” Proc. of the 31st Int. Conf. on Neural Information Processing Systems, pp. 6000-6010, 2017.
25. [25] J. D. Lafferty, A. McCallum, and F. C. N. Pereira, “Conditional random fields: Probabilistic models for segmenting and labeling sequence data,” Proc. of the 18th Int. Conf. on Machine Learning, pp. 282-289, 2001.
26. [26] Y. Liu et al., “RoBERTa: A robustly optimized BERT pretraining approach,” arXiv:1907.11692, 2019. https://doi.org/10.48550/arXiv.1907.11692