Abstract

This paper proposes a new and efficient methodology for clustering of html documents. The topic wise categorization of documents into different clusters makes searching easier and efficient. This technique can be utilized by search engines to provide relevant results to the user according to query and also utilized by online journal domains that are maintaining large set of documents. This paper suggests a good word matching and naming of automatic generated clusters , so, the time consume for finding the appropriate cluster for a document will be reduced. This paper shows the use of an efficient technique for finding the similarity between the documents and assigns them a proper cluster. The proper clustering of documents will be further utilized by multidocument summarization system, which produces a summary for the documents related to each other.

References

• McCallum, Andrew Kachites. "MALLET: A Machine Learning for Language Toolkit. " http://mallet. cs. umass. edu. 2002.
• . S. Chakrabarti, B. Dom. R. Agrawal, P. Raghavan. Using taxonomy, discriminants and signatures for navigating in text databases, VLDB Conference, 1997.
• B. Liu, L. Zhang. A Survey of Opinion Mining and Sentiment Analysis. Book Chapter in Mining Text Data, Ed. C. Aggarwal, C. Zhai, Springer, 2011.
• M. Sahami, S. Dumais, D. Heckerman, E. Horvitz. A Bayesian approach to filtering junk e-mail. AAAI Workshop on Learning for Text Categorization. Tech. Rep. WS-98-05, AAAI Press. http://robotics. stanford. edu/users/sahami/papers. html.
• A. Y. Ng, M. I. Jordan. On discriminative vs. generative classifiers: a comparison of logistic regression and naive Bayes. NIPS. pp. 841- 848, 2001.
• J. R. Quinlan, Induction of Decision Trees, Machine Learning, 1(1), pp 81–106, 1986.
• A. McCallum, K. Nigam. A Comparison of Event Models for Naïve Bayes Text Classification. AAAI Workshop on Learning for Text Categorization, 1998.
• C. Cortes, V. Vapnik. Support-vector networks. Machine Learning, 20: pp. 273– 297, 1995.
• Fabrizio Silvestri, Raffaele Perego and Salvatore Orlando. "Assigning Document Identifiers to Enhance Compressibility of Web Search Engines Indexes" In the proceedings of SAC, 2004.
• Van Rijsbergen C. J. "Information Retrieval" Butterworth 1979
• Oren Zamir and Oren Etzioni. "Web Document Clustering: A feasibility demonstration" In the pr oceedings of SIGIR, 1998.
• Jain and R. Dubes. "Algorithms for Clustering Data. " Prentice Hall, 1988
• Sanjiv K. Bhatia. "Adaptive K Means Clustering" American Association for. Artificial Intelligence, 2004
• Bhatia, S. K. and Deougan , J. S. 1998. "Conceptual Clustering in Information and Cybernetics.