Research Article
Implementation of Text Similarity using Cosine Similarity Method in Python
|
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
|
| Volume 185 - Issue 2 |
| Published: Apr 2023 |
| Authors: Ahmad Farhan Alshammari |
10.5120/ijca2023922667
|
Ahmad Farhan Alshammari . Implementation of Text Similarity using Cosine Similarity Method in Python. International Journal of Computer Applications. 185, 2 (Apr 2023), 11-14. DOI=10.5120/ijca2023922667
@article{ 10.5120/ijca2023922667,
author = { Ahmad Farhan Alshammari },
title = { Implementation of Text Similarity using Cosine Similarity Method in Python },
journal = { International Journal of Computer Applications },
year = { 2023 },
volume = { 185 },
number = { 2 },
pages = { 11-14 },
doi = { 10.5120/ijca2023922667 },
publisher = { Foundation of Computer Science (FCS), NY, USA }
}
%0 Journal Article
%D 2023
%A Ahmad Farhan Alshammari
%T Implementation of Text Similarity using Cosine Similarity Method in Python%T
%J International Journal of Computer Applications
%V 185
%N 2
%P 11-14
%R 10.5120/ijca2023922667
%I Foundation of Computer Science (FCS), NY, USA
Abstract
The goal of this research is to develop a text similarity program using cosine similarity method in Python. The steps of text similarity process are: preprocessing text, word-tokenization, creating list of words, creating bag of words, calculating word frequency, and calculating cosine similarity. The developed program was examined on two experimental texts from Wikipedia. The program successfully performed the steps of text similarity and provided the required results.
References
- Hotho, A., Nürnberger, A., & Paass, G. (2005). "A Brief Survey of Text Mining". LDV Forum - GLDV Journal for Computational Linguistics and Language Technology. 20, 19-62.
- Salton, G. & Lesk, M. E. (1965). "The SMART Automatic Document Retrieval Systems: An Illustration". Communications of the ACM. 8 (6): 391-398.
- Salton, G. (1971). "The SMART Retrieval System: Experiments in Automatic Document Retrieval". Englewood Cliffs, N.J.: Prentice Hall Inc.
- Salton, G., Wong, A., & Yang, C. (1975). "A Vector Space Model for Automatic Indexing". Communications of the ACM, 18(11), 613-620.
- Salton, G., & Buckley, C. (1988). "Term-Weighting Approaches in Automatic Text Retrieval". Information Processing and Management, 24(5), 513-523.
- Salton, G. & McGill, M. (1983). "Introduction to Modern Information Retrieval". McGraw Hill Book Co, New York.
- Salton, G., Allan, J., & Buckley, C. (1994). "Automatic Structuring and Retrieval of Large Text Files". Communications of the ACM, 37(2), 97-108.
- Python: https://www.python.org
- Numpy: https://www.numpy.org
- Pandas: https:// pandas.pydata.org
- Matplotlib: https://www. matplotlib.org
- NLTK: https://www.nltk.org
- SciKit: https://scikit-learn.org
- Wikipedia: https://en.wikipedia.org
Index Terms
Keywords