Abstract
Document similarity is one among the most significant problems in knowledge discovery and information retrieval. Most of the works in document similarity only focus on textual content of the documents. However, these similarity measures do not provide an accurate measure. An alternative is to incorporate citation information into similarity measure. The content of a document can be improved by considering the content of cited documents, which is the key behind this alternative. In this work, citation network analysis is used to expand the content of citing document by including the information given in cited documents. The next issue is the representation of documents. A commonly used document representation is bag-of-words model. But it does not capture the meaning or semantics of the text as well as the ordering of the words. Hence, this proposed work uses word embedding representation. Word embedding represents a word as a dense vector with low dimensionality. Word2vec model is used to generate word embedding which can capture contextual similarity between words. The similarity between documents is measured using word mover’s distance, which is based on the word embedding representation of words. The proposed work takes advantage of both textual similarity and contextual similarity. Experiments showed that the proposed method provides better results compared to other state-of-the-art methods.
Keywords
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Barrn-Cedeno, A., Eiselt, A., Rosso, P.: Monolingual text similarity measures: a comparison of models over wikipedia articles revisions. In: Proceedings of the ICON: 7th International Conference on NLP, pp. 29–38 (2009)
Jeh, G., Widom, J.: SimRank: a measure of structural context similarity. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2002)
Zhao, P., Han, J., Sun, Y.: P-Rank: a comprehensive structural similarity measure over information networks. In: Proceedings of the 18th ACM Conference on Information and Knowledge Management (2009)
Chikhi, N.F., Rothenburger, B., Aussenac-Gilles, N.: Combining link and content information for scientific topics discovery. In 20th IEEE International Conference on Tools with Artificial Intelligence ICTAI’08, vol. 2, pp. 211–214 (2008)
Hamedani, M.R., Lee, S.C. and Kim, S.W.: On combining text-based and link-based similarity measures for scientific papers. In: Proceedings of the 2013 Research in Adaptive and Convergent Systems, pp. 111–115 (2013)
Yoon, S.H., Kim, S.W., Kim, J.S., Hwang, W.S.: On computing text-based similarity in scientific literature. In: Proceedings of the 20th International Conference Companion on World Wide Web, pp. 169–170. ACM (2011)
Bengio, Y., Ducharme, R., Vincent, P. and Jauvin, C.: A neural probabilistic language model. J. Mach. Learn. Res. 1137–1155 (2003)
Collobert, R., Weston, J.: A unified architecture for natural language processing: Deep neural networks with multitask learning. In: Proceedings of the 25th international conference on Machine Learning. pp. 160–167 (2008)
Mikolov, T., Sutskever, I., Chen, K., Corrado, G.S., Dean, J.: Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp. 3111–3119 (2013)
Rong, X.: Word2vec parameter learning explained (2014). arXiv:1411.2738
Kusner, M.J., Sun, Y., Kolkin, N.I., Weinberger, K.Q.: From word embeddings to document distance. ICML 15, 957–966 (2015)
Pele, O., Werman, M.: Fast and robust earth mover’s distances. In: 2009 IEEE 12th international conference on Computer vision, pp. 460–467 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Lamiya, K., Mohan, A. (2018). A Document Similarity Computation Method Based on Word Embedding and Citation Analysis. In: Sa, P., Bakshi, S., Hatzilygeroudis, I., Sahoo, M. (eds) Recent Findings in Intelligent Computing Techniques . Advances in Intelligent Systems and Computing, vol 709. Springer, Singapore. https://doi.org/10.1007/978-981-10-8633-5_17
Download citation
DOI: https://doi.org/10.1007/978-981-10-8633-5_17
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-8632-8
Online ISBN: 978-981-10-8633-5
eBook Packages: EngineeringEngineering (R0)