Abstract

Due to the exponential growth of online textual data, and rapid expansion of internet usage, tasks such as document management, text classification, and information retrieval have been significantly posing a challenge due to its huge size. A key tool for addressing this issue is Automatic Text Summarization (ATS). It is one of the most challenging tasks since there is no precise computational method for evaluating accuracy of a summary.[1] The main function of ATS is to automatically create a concise and apprehensive summary by extracting the main ideas from the source text. Models for abstractive summarization based on deep learning (DL) have recently been created to better balance and improve these two elements. The field of DL-based text summarization currently lacks a thorough literature review, nevertheless. This work offers researchers a thorough analysis of DL-based text summarization in order to close this gap. In this paper, many prevalent frameworks for text summarization are listed. We also propose Summa - an Abstractive text summarizer which uses Long Short Term Memory(LSTM) based Sequence to Sequence Model. Accuracy matrix or F1 score are not recommended, traditional evaluation measures for text summarisation are not that much relevant so, a novel measure, Bi-Lingual Evaluation Understudy(BLEU)[2] measure is used. The study reported the BLEU score of 0.71, with attention mechanism and 0.3, without Attention Mechanism, which is considered a good score.

References

• Papineni, K.; Roukos, S.; Ward, T.; Zhu, W. J. (2002). BLEU: a method for automatic evaluation of machine translation (PDF). ACL-2002: 40th Annual meeting of the Association for Computational Linguistics. pp. 311–318
• BLEU. In Wikipedia. https://en.wikipedia.org/wiki/BLEU
• From Extractive to Abstractive Summarization: A Journey, by Parth Mehta, Prasenjeet Mujumde
• Yan Du, Hua Huo* "News Text Summarization Based on Multi-Feature and Fuzzy Logic", 2020, IEEE
• Amir Shahab Shahabi, Mohammad Reza Kangavari, Amir Masoud Rahmani. “ A Method for Multi-text Summarization Based on Multi-objective Optimization use Imperialist Competitive Algorithm” March 2022
• Muhammad Afzal, Fakhare Alam, Khalid Mahmood Malik, Ghaus M Malik, "Clinical Context–Aware Biomedical Text Summarization Using Deep Neural Network: Model Development and Validation" 2020 JMIR
• Zhixin Li, Zhi Peng, Suqin Tang, Canlong Zhang, Huifang Ma"Text Summarization Method Based on Double Attention Pointer Network" 2022
• Jingjing Cheng, Fucheng Yu. “Text summarization Generation Based On semantic similarity” 2021
• Hikmat A. M. Abdeljaber, Sultan Ahmad, Abdullah Alharbi, and Sudhir Kumar  “XAI-Based Reinforcement Learning Approach for Text Summarization of Social IoT-Based Content” 2022
• Kasimahanthi Divya, Kambala Sneha, Bassetti Sowmya, G Sankara Rao, "Text Summarization using Deep Learning"2020, IRJET(ISSN: 2395-0056)
• Liyan Tang, Zifan Xu, "GOLD-FACTUAL: Learning to Generate Faithful Summaries from models Generations" 2021
• Devi Fitrianah, Raihan Nugroho Jauhari, "Extractive text summarization for scientific journal articles using long short-term memory and gated recurrent units" 2022 (ISSN: 2302-9285)
• Youngji Koh, Sungwon Kang, Seonah Lee. “Bug Report Summarization using Believability Score and Text Ranking” 2021
• SAMIRA GHODRATNAMA, AMIN BEHESHTI, MEHRDAD ZAKERSHAHRAK, AND FARIBORZ SOBHANMANESH “Extractive Document Summarization Based on Dynamic Feature Space Mapping” 2020
• HEEWON JANG AND WOOJU KIM “Reinforced Abstractive Text Summarization With Semantic Added Reward” 2021
• ISKANDER AKHMETOV, ALEXANDER GELBUKH, AND RUSTAM MUSSABAYEV  “Greedy Optimization Method for Extractive Summarization of Scientific Articles”  2021
• JIANLI DING, YANG LI, HUIYU NI, AND ZHENGQUAN YANG “Generative Text Summary Based on Enhanced Semantic Attention and Gain-Benefit Gate” 2020
• Nikhil S. Shirwandkar,  Samidha Kulkarni  “Extractive Text Summarization using Deep Learning” 2020
• Architecture of LSTM [Image]. Retrieved from https://raw.githubusercontent.com/d2l-ai/d2l-en/master/img/ls