A Multi-Agent Personalized Query Refinement Approach for Academic Paper Retrieval in Big Data Environment
Qian Gao* and Young Im Cho**
*School of information, Shandong Polytechnic University, 3501 University-ro, Changqing-gu, Jinan 250-353, China
**College of Information Technology, University of Suwon, San 2-2, Bongdam-eup, Hwaseong-si 445-743, Korea
This paper proposes a multi-agent query refinement approach to realize personalized query expansion effective for academic paper retrieval in a Big Data environment. First, we use Hadoop as a platform to develop a formalized model to represent different types of large caches of data in order to analyze and process Big Data efficiently. Second, we use a client agent to verify user identities and monitor whether a device is ready to run a query-expanded task. We then use a query expansion agent to determine the domain that the initial query belongs to by applying a knowledgebased query expansion strategy and comprehensively considering users’ interests according to the intelligent devices they use by implementing a user-device-based query expansion strategy and a weighted query expansion strategy in order to obtain the optimized query expansion set. We compare our method with the conceptual retrieval method as well as other two lexical methods for query expansion, and we prove that our method has better average recall and average precision ratios.
-  http://www.worldwidewebsize.com/
-  http://kusnetzky.net/analysts-take/
-  A. Spink, B. J. Jansen et al., “A study of results overlap and uniqueness among major Web search engines,” Information Processing and Management, Vol.42, pp. 1379-1391, 2006.
-  D. Cai, C. J. Rijsbergen, and J. M. Jose, “Automatic Query Expansion based on Divergence,” Proc. of the 10th Int. Conf. on Information and Knowledge Management (CIKM-01), pp. 419-426, 2001.
-  E. M. Voorhees, “Query Expansion Using Lexical-Semantic Relations,” Proc. of the 17th Annual Int. ACM-SIGIR Conf. on Research and Development in Information Retrieval, pp. 61-69, 1994.
-  G. Fu, C. B. Jones, and A. I. Abdelmoty, “Ontology-based Spatial Query Expansion in Information Retrieval,” OTMConfederated Int. Conf., pp. 1466-1482, 2005.
-  Z. Liu, S. Natarajan, and Y. Chen, “Query expansion based on clustered results,” Proc. of the VLDB Endowment, Vol.4, pp. 350-361, 2011.