Research Article
Machine Learning Approaches for Bengali Automated Question Detection System
|
International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
|
| Volume 178 - Issue 22 |
| Published: Jun 2019 |
| Authors: Saifuddin Al Azad Sagor, Nurul Azim Rizvi, Md Mahadi Hasan Nahid |
10.5120/ijca2019918937
|
Saifuddin Al Azad Sagor, Nurul Azim Rizvi, Md Mahadi Hasan Nahid . Machine Learning Approaches for Bengali Automated Question Detection System. International Journal of Computer Applications. 178, 22 (Jun 2019), 1-4. DOI=10.5120/ijca2019918937
@article{ 10.5120/ijca2019918937,
author = { Saifuddin Al Azad Sagor,Nurul Azim Rizvi,Md Mahadi Hasan Nahid },
title = { Machine Learning Approaches for Bengali Automated Question Detection System },
journal = { International Journal of Computer Applications },
year = { 2019 },
volume = { 178 },
number = { 22 },
pages = { 1-4 },
doi = { 10.5120/ijca2019918937 },
publisher = { Foundation of Computer Science (FCS), NY, USA }
}
%0 Journal Article
%D 2019
%A Saifuddin Al Azad Sagor
%A Nurul Azim Rizvi
%A Md Mahadi Hasan Nahid
%T Machine Learning Approaches for Bengali Automated Question Detection System%T
%J International Journal of Computer Applications
%V 178
%N 22
%P 1-4
%R 10.5120/ijca2019918937
%I Foundation of Computer Science (FCS), NY, USA
Abstract
Question detection is the initial tasks of question answering system. Question detection, the first step of QA system has been done applying SVM, Logistic Regression, K-Neighbor classifier, Multilayer Perceptron and LSTM. We achieved best performance for SVM with linear kernel trick. For 2000 feature words we got 1.4% error rate which is best among the approaches we used for Bengali language. For LSTM algorithm we got 3.22% error rate. LSTM looks promising with large and better dataset.
References
- K. Wang and T.-S. Chua, “Exploiting salient patterns for question detection and question retrieval in community-based question answering,” in Proceedings of the 23rd International Conference on Computational Linguistics. Association for Computational Linguistics, 2010, pp. 1155–1163.
- K. Boakye, B. Favre, and D. Hakkani-Tür, “Any questions? Automatic question detection in meetings,” in Automatic Speech Recognition & Understanding, 2009. ASRU 2009. IEEE Workshop on. IEEE, 2009, pp. 485–489.
- S. Azzam, N. Caldwell, and D. P. Del Carpio, “Automatic question and answer detection,” Oct. 15 2013, uS Patent 8,560,567
- S. Banerjee, S. K. Naskar, and S. Bandyopadhyay, “Bfqa: A Bengali factoid question answering system,” in International Conference on Text, Speech, and Dialogue. Springer, 2014, pp. 217–224.
- B. F. Green Jr, A. K. Wolf, C. Chomsky, and K. Laughery, “Baseball: an automatic question-answerer,” in Papers presented at the May 9-11, 1961, western joint IRE-AIEE-ACM computer conference. ACM, 1961, pp. 219–224.
- W. A. Woods, “Progress in natural language understanding: an application to lunar geology,” in Proceedings of the June 4-8, 1973, national computer conference and exposition. ACM, 1973, pp. 441–450.
- E. Nyberg, T. Mitamura, J. G. Carbonell, J. Callan, K. CollinsThompson, K. Czuba, M. Duggan, L. Hiyakumoto, N. Hu, Y. Huang et al., “The javelin question-answering system at trec 2002,” Proceedings of TREC 11, 2002.
- E. Brill, S. Dumais, and M. Banko, “An analysis of the askmsr question-answering system,” in Proceedings of the ACL-02 conferenceon Empirical methods in natural language processing-Volume 10.Association for Computational Linguistics, 2002, pp. 257–264.
- Z. Zheng, “Answerbus question answering system,” in Proceedings of the second international conference on Human Language Technology Research. Morgan Kaufmann Publishers Inc., 2002, pp. 399–404.
- L. Zou, R. Huang, H. Wang, J. X. Yu, W. He, and D. Zhao, “Natural language question answering over rdf: a graph data driven approach,” in Proceedings of the 2014 ACM SIGMOD international conference on Management of data. ACM, 2014, pp. 313–324.
- E. Cabrio, J. Cojan, A. P. Aprosio, B. Magnini, A. Lavelli, and F. Gandon, “Qakis: an open domain qa system based on relational patterns,” in Proceedings of the 2012th International Conference on Posters & Demonstrations Track-Volume 914. CEUR-WS. org, 2012, pp. 9–12.
- F. Schulze, R. Schüler, T. Draeger, D. Dummer, A. Ernst, P. Flemming, C. Perscheid, and M. Neves, “Hpi question answering system in bioasq 2016,” in Proceedings of the Fourth BioASQ workshop at the Conference of the Association for Computational Linguistics, 2016, pp. 38–44.
- S. M. H. Nirob, M. K. Nayeem, and M. S. Islam, “Question classification using support vector machine with hybrid feature extraction method,” in Computer and Information Technology (ICCIT), 2017 20th International Conference of. IEEE, 2017, pp. 1–6.
Index Terms
Keywords