Abstract

In this paper, a brief study of the advancements in the Question Answering domain as a type of information retrieval system is presented. Question Answering systems are responsible to provide answers to the questions proposed over a knowledge base in natural language to retrieve the required information. The promising results achieved in Question Answering in Natural Language Processing are discussed. The aim is to cover a concise yet complete understanding of the advances in Question Answering Systems classified based on domain and question type and brief information about metrics used to evaluate the system.

References

• E. Cabrio, J. Cojan, F. Gandon, and A. Hallili, “Querying multilingual dbpedia with qakis,” in Extended Semantic Web Conference. Springer, 2013, pp. 194–198.
• C. Comparot, O. Haemmerle, and N. Hernandez, “An easy way of ´ expressing conceptual graph queries from keywords and query patterns,” in International Conference on Conceptual Structures. Springer, 2010, pp. 84–96.
• G. Tsatsaronis, G. Balikas, P. Malakasiotis, I. Partalas, M. Zschunke, M. R. Alvers, D. Weissenborn, A. Krithara, S. Petridis, D. Polychronopoulos et al., “An overview of the bioasq large-scale biomedical semantic indexing and question answering competition,” BMC bioinformatics, vol. 16, no. 1, p. 138, 2015.
• C. Unger, C. Forascu, V. Lopez, A.-C. N. Ngomo, E. Cabrio, P. Cimiano, and S. Walter, “Question answering over linked data (qald-4),” 2014.
• C. Unger, A.-C. N. Ngomo, and E. Cabrio, “6th open challenge on question answering over linked data (qald-6),” in Semantic Web Evaluation Challenge. Springer, 2016, pp. 171–177.
• R. Usbeck, M. Roder, P. Haase, A. Kozlov, M. Saleem, and A.- ¨ C. N. Ngomo, “Requirements to modern semantic search engine,” in International Conference on Knowledge Engineering and the Semantic Web. Springer, 2016, pp. 328–343.
• J. Ko, L. Si, and E. Nyberg, “Combining evidence with a probabilistic framework for answer ranking and answer merging in question answering,” Information processing & management, vol. 46, no. 5, pp. 541–554, 2010.
• C. Manning, “Text-based question answering systems.” p. p. 7., 2013.
• A. Bouziane, D. Bouchiha, N. Doumi, and M. Malki, “Question answering systems: survey and trends,” Procedia Computer Science, vol. 73, pp. 366–375, 2015.
• A.-M. Popescu, O. Etzioni, and H. Kautz, “Towards a theory of natural language interfaces to databases,” in Proceedings of the 8th international conference on Intelligent user interfaces. ACM, 2003, pp. 149–157.
• A. De Roeck, A natural language system based on formal semantics. Universiti Sains Malaysia, 1991.
• I. Androutsopoulos, G. D. Ritchie, and P. Thanisch, “Natural language interfaces to databases–an introduction,” Natural language engineering, vol. 1, no. 1, pp. 29–81, 1995.
• W. A. Woods, “Progress in natural language understanding: an application to lunar geology,” in Proceedings of the June 4-8, 1973, national computer conference and exposition. ACM, 1973, pp. 441–450.
• E. Hovy, L. Gerber, U. Hermjakob, M. Junk, and C.-Y. Lin, “Question answering in webclopedia,” in TREC, vol. 52, 2000, pp. 53–56.
• M. Wu, X. Zheng, M. Duan, T. Liu, T. Strzalkowski, and S. Albany, “Question answering by pattern matching, web-proofing, semantic form proofing,” in NIST Special Publication: The Twelfth Text REtrieval Conference (TREC), 2003, pp. 500–255.
• D. Moldovan, S. Harabagiu, M. Pasca, A. Harabagiu, R. Mihalcea, R. Girju, R. Goodrum, and V. Rus, “Lasso: A tool for surfing the answer net,” 1999.
• R. Srihari and W. Li, “Information extraction supported question answering,” CYMFONY NET INC WILLIAMSVILLE NY, Tech. Rep., 1999.
• S. Harabagiu, D. Moldovan, M. Pasca, R. Mihalcea, M. Surdeanu, R. Bunescu, R. Girju, V. Rus, and P. Morarescu, “Falcon: Boosting knowledge for answer engines,” in TREC, vol. 9, 2000, pp. 479–488.
• K. C. Litkowski, “Syntactic clues and lexical resources in questionanswering,” NIST SPECIAL PUBLICATION SP, vol. 249, pp. 157–166, 2001.
• C. Kwok, O. Etzioni, O. Etzioni, and D. S. Weld, “Scaling question answering to the web,” ACM Transactions on Information Systems (TOIS), vol. 19, no. 3, pp. 242–262, 2001.
• V. Lopez, V. Uren, E. Motta, and M. Pasin, “Aqualog: An ontologydriven question answering system for organizational semantic intranets,” Web semantics: science, services and agents on the world wide web, vol. 5, no. 2, pp. 72–105, 2007.
• V. Lopez, M. Fernandez, E. Motta, and N. Stieler, “Poweraqua: Sup- ´ porting users in querying and exploring the semantic web,” Semantic Web, vol. 3, no. 3, pp. 249–265, 2012.
• A. Kalyanpur, B. K. Boguraev, S. Patwardhan, J. W. Murdock, A. Lally, C. Welty, J. M. Prager, B. Coppola, A. Fokoue-Nkoutche, L. Zhang et al., “Structured data and inference in deepqa,” IBM Journal of Research and Development, vol. 56, no. 3.4, pp. 10–1, 2012.
• C. Wang, M. Xiong, Q. Zhou, and Y. Yu, “Panto: A portable natural language interface to ontologies,” in European Semantic Web Conference. Springer, 2007, pp. 473–487.
• A. Allam and M. Haggag, “The question answering systems: A survey,” International Journal of Research and Reviews in Information Sciences, vol. 2, pp. 211–221, 09 2012.
• B. Dhingra, K. Mazaitis, and W. W. Cohen, “Quasar: Datasets for question answering by search and reading,” arXiv preprint arXiv:1707.03904, 2017.
• T. Nguyen, M. Rosenberg, X. Song, J. Gao, S. Tiwary, R. Majumder, and L. Deng, “Ms marco: A human-generated machine reading comprehension dataset,” 2016.
• M. Joshi, E. Choi, D. S. Weld, and L. Zettlemoyer, “Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension,” arXiv preprint arXiv:1705.03551, 2017.
• M. Dunn, L. Sagun, M. Higgins, V. U. Guney, V. Cirik, and K. Cho, “Searchqa: A new q&a dataset augmented with context from a search engine,” arXiv preprint arXiv:1704.05179, 2017.
• P. Rajpurkar, J. Zhang, K. Lopyrev, and P. Liang, “Squad: 100,000+ questions for machine comprehension of text,” arXiv preprint arXiv:1606.05250, 2016.
• Z. Yang, P. Qi, S. Zhang, Y. Bengio, W. W. Cohen, R. Salakhutdinov, and C. D. Manning, “Hotpotqa: A dataset for diverse, explainable multi-hop question answering,” arXiv preprint arXiv:1809.09600, 2018.
• E. M. Voorhees, “Question answering in trec,” in Proceedings of the tenth international conference on Information and knowledge management. ACM, 2001, pp. 535–537.
• Y. Tay, L. A. Tuan, S. C. Hui, and J. Su, “Densely connected attention propagation for reading comprehension,” 2018.
• S. Wang, M. Yu, J. Jiang, W. Zhang, X. Guo, S. Chang, Z. Wang, T. Klinger, G. Tesauro, and M. Campbell, “Evidence aggregation for answer re-ranking in open-domain question answering,” 2017.
• D. Chen, A. Fisch, J. Weston, and A. Bordes, “Reading wikipedia to answer open-domain questions,” 2017.
• N. Indurkhya and F. J. Damerau, Handbook of natural language processing. Chapman and Hall/CRC, 2010.
• V. Lopez, V. Uren, M. Sabou, and E. Motta, “Is question answering fit for the semantic web?: a survey,” Semantic Web, vol. 2, no. 2, pp. 125–155, 2011.
• D. Molla and J. L. Vicedo, “Question answering in restricted domains: ´ An overview,” Computational Linguistics, vol. 33, no. 1, pp. 41–61, 2007.
• H. Doan-Nguyen and L. Kosseim, “Improving the precision of a closed-domain question-answering system with semantic information,” in Coupling Approaches, Coupling Media and Coupling Languages for Information Retrieval, ser. RIAO ’04. Paris, France, France: LE CENTRE DE HAUTES ETUDES INTERNATIONALES D’INFORMATIQUE DOCUMENTAIRE, 2004, pp. 850–859. [Online]. Available: http://dl.acm.org/citation.cfm?id=2816272.2816351
• M. A. T. N. O. S. Felix Mikaelian, Andr ´ e Farias, “cdqa: Closed domain ´ question answering - an end-to-end closed domain question answering system,” https://github.com/cdqa-suite/cdQA, 2019.
• A. Mishra and S. K. Jain, “A survey on question answering systems with classification,” Journal of King Saud University-Computer and Information Sciences, vol. 28, no. 3, pp. 345–361, 2016.
• R. Higashinaka and H. Isozaki, “Corpus-based question answering for why-questions,” in Proceedings of the Third International Joint Conference on Natural Language Processing: Volume-I, 2008.
• S. Verberne, L. Boves, N. Oostdijk, and P. Coppen, “Discourse-based answering of why-questions,” 2007.
• S. Verberne, L. Boves, N. Oostdijk, and P.-A. Coppen, “Using syntactic information for improving why-question answering,” in Proceedings of the 22nd International Conference on Computational Linguistics-Volume 1. Association for Computational Linguistics, 2008, pp. 953–960.
• ——, “What is not in the bag of words for why-qa?” Computational Linguistics, vol. 36, no. 2, pp. 229–245, 2010.
• D. Moldovan, S. Harabagiu, M. Pasca, R. Mihalcea, R. Girju, R. Goodrum, and V. Rus, “The structure and performance of an opendomain question answering system,” in Proceedings of the 38th annual meeting on association for computational linguistics. Association for Computational Linguistics, 2000, pp. 563–570.
• M. A. C. Soares and F. S. Parreiras, “A literature review on question answering techniques, paradigms and systems,” Journal of King Saud University-Computer and Information Sciences, 2018.
• A. Severyn and A. Moschitti, “Learning to rank short text pairs with convolutional deep neural networks,” in Proceedings of the 38th international ACM SIGIR conference on research and development in information retrieval. ACM, 2015, pp. 373–382.
• J. Andreas, M. Rohrbach, T. Darrell, and D. Klein, “Learning to compose neural networks for question answering,” arXiv preprint arXiv:1601.01705, 2016.
• R. M. D. T. K. D. Andreas, Jacob, “Neural module networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 39–48.
• L. Dong, F. Wei, M. Zhou, and K. Xu, “Question answering over freebase with multi-column convolutional neural networks,” in Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), 2015, pp. 260–269.
• C. Xiong, S. Merity, and R. Socher, “Dynamic memory networks for visual and textual question answering,” in International conference on machine learning, 2016, pp. 2397–2406.
• C. Xiong, V. Zhong, and R. Socher, “Dynamic coattention networks for question answering,” arXiv preprint arXiv:1611.01604, 2016.
• S. W.-t. Yih, M.-W. Chang, X. He, and J. Gao, “Semantic parsing via staged query graph generation: Question answering with knowledge base,” 2015.
• D. Teney, L. Liu, and A. van den Hengel, “Graph-structured representations for visual question answering,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 1–9.
• Y. Zhang, H. Dai, Z. Kozareva, A. J. Smola, and L. Song, “Variational reasoning for question answering with knowledge graph,” in ThirtySecond AAAI Conference on Artificial Intelligence, 2018.
• J. Bao, N. Duan, Z. Yan, M. Zhou, and T. Zhao, “Constraint-based question answering with knowledge graph,” in Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, 2016, pp. 2503–2514.
• D. Molla, M. van Zaanen, and D. Smith, “Named entity recognition ´ for question answering,” in Proceedings of the Australasian Language Technology Workshop 2006, Sydney, Australia, Nov. 2006, pp. 51–58. [Online]. Available: https://www.aclweb.org/anthology/U06-1009
• A. Toral, E. Noguera, F. Llopis, and R. Munoz, “Improving question answering using named entity recognition,” in International Conference on Application of Natural Language to Information Systems. Springer, 2005, pp. 181–191.
• W. Wang, J. Auer, R. Parasuraman, I. Zubarev, D. Brandyberry, and M. Harper, “A question answering system developed as a project in a natural language processing course,” in Proceedings of the 2000 ANLP/NAACL Workshop on Reading comprehension tests as evaluation for computer-based language understanding sytems-Volume 6. Association for Computational Linguistics, 2000, pp. 28–35.
• L. Hirschman, M. Light, E. Breck, and J. D. Burger, “Deep read: A reading comprehension system,” in Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics. Association for Computational Linguistics, 1999, pp. 325– 332.
• C. Unger, L. Buhmann, J. Lehmann, A.-C. Ngonga Ngomo, D. Gerber, ¨ and P. Cimiano, “Template-based question answering over rdf data,” in Proceedings of the 21st International Conference on World Wide Web, ser. WWW ’12. New York, NY, USA: ACM, 2012, pp. 639–648. [Online]. Available: http://doi.acm.org/10.1145/2187836.2187923
• O. Corby, C. F. Zucker, and F. Gandon, “Sparql template: a transformation language for rdf,” 2014.
• X. Yao, “Feature-driven question answering with natural language alignment,” Ph.D. dissertation, Johns Hopkins University, 2014.,” unpublished.