From Extractive to Abstractive Summarization: A Journey

1. Auflage 2019
ISBN: 978-981-13-8936-8
Verlag: Springer Nature Singapore

Buch, Englisch, 116 Seiten, Format (B × H): 155 mm x 235 mm, Gewicht: 234 g

This book describes recent advances in text summarization, identifies remaining gaps and challenges, and proposes ways to overcome them. It begins with one of the most frequently discussed topics in text summarization – ‘sentence extraction’ –, examines the effectiveness of current techniques in domain-specific text summarization, and proposes several improvements. In turn, the book describes the application of summarization in the legal and scientific domains, describing two new corpora that consist of more than 100 thousand court judgments and more than 20 thousand scientific articles, with the corresponding manually written summaries. The availability of these large-scale corpora opens up the possibility of using the now popular data-driven approaches based on deep learning. The book then highlights the effectiveness of neural sentence extraction approaches, which perform just as well as rule-based approaches, but without the need for any manual annotation. As a next step, multiple techniques for creating ensembles of sentence extractors – which deliver better and more robust summaries – are proposed. In closing, the book presents a neural network-based model for sentence compression. Overall the book takes readers on a journey that begins with simple sentence extraction and ends in abstractive summarization, while also covering key topics like ensemble techniques and domain-specific summarization, which have not been explored in detail prior to this.

Zielgruppe

Research

Autoren/Hrsg.

Majumder, Prasenjit

Mehta, Parth

Fachgebiete

• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz Spracherkennung, Sprachverarbeitung
• Mathematik | Informatik EDV | Informatik Informatik Künstliche Intelligenz Wissensbasierte Systeme, Expertensysteme
• Mathematik | Informatik EDV | Informatik Angewandte Informatik

Inhaltsverzeichnis

1 Introduction
1.1 Extractive Summarization1.2 Information Fusion and Ensemble Techniques1.3 Abstractive Summarization1.4 Main contributions1.5 Organization
2 Related Work
2.1 Extractive Summarization2.1.1 Legal Document Summarization2.1.2 Scientific article Summarization2.2 Ensemble techniques for extractive summarization2.3 Sentence compression
3 Domain specific Extractive Summarization
3.1 Corpora3.2 Legal document Summarization3.2.1 Boosting legal vocabulary using a lexicon3.2.2 Weighted TextRank and LexRank3.2.3 Automatic key phrase identification3.2.4 Attention based sentence extractor3.3 Scientific article summarization3.4 Experiment Details3.4.1 Results3.5 Conclusion
4 Improving extractive techniques through rank aggregation
4.1 Motivation for rank aggregation4.2 Analysis of existing extractive systems4.2.1 Experimental Setup4.3 Ensemble of extractive summarization systems4.3.1 Effect of Informed fusion4.4 Discussion4.4.1 Determining the robustness of candidate systems4.4.2 Qualitative analysis of summaries
5 Leveraging content similarity in summaries for generating better ensembles
5.1 Limitations of consensus based aggregation5.2 Proposed approach for content based aggregation5.3 Document level aggregation5.3.1 Experimental results5.4 Sentence Level aggregation5.4.1 SentRank5.4.2 GlobalRank5.4.3 LocalRank5.4.4 HybridRank5.4.5 Experimental Results5.5 Conclusion
6 Neural model for sentence compression
6.1 Sentence compression by deletion6.2 Sentence compression using Sequence to Sequence model6.2.1 Sentence Encoder6.2.2 Context Encoder6.2.3 Decoder6.2.4 Attention module6.3 Exploiting SMT techniques for sentence compression6.4 Results for sentence compression6.5 Limitations of sentence compression techniques6.6 Overall System
7 Conclusion and Future Work

Über Autor(innen)

Dr. Parth Mehta completed his M.Tech. in Machine Intelligence and his Ph.D. in Text Summarization at Dhirubhai Ambani Institute of ICT (DA-IICT), Gandhinagar, India. At the DA-IICT he was part of the Information Retrieval and Natural Language Processing Lab. He was also involved in the national project “Cross Lingual Information Access”, funded by the Govt. of India, which focused on building a cross-lingual search engine for nine Indian languages. Dr. Mehta has served as reviewer for the journals Information Processing and Management and Forum for Information Retrieval Evaluation. Apart from several journal and conference papers, he has also co-edited a book on text processing published by Springer. Prof. Prasenjit Majumder is an Associate Professor at Dhirubhai Ambani Institute of ICT (DA-IICT), Gandhinagar and a Visiting Professor at the Indian Institute of Information Technology, Vadodara (IIIT-V). Prof. Majumder completed his Ph.D. at JadavpurUniversity in 2008 and worked as a postdoctoral fellow at the University College Dublin, prior to joining the DA-IICT, where he currently heads the Information Retrieval and Language Processing Lab. His research interests lie at the intersection of Information Retrieval, Cognitive Science and Human Computing Interaction. He has headed several projects sponsored by the Govt. of India. He is one of the pioneers of the Forum for Information Retrieval Evaluation (FIRE), which assesses research on Information Retrieval and related areas for South Asian languages. Since being founded in 2008, FIRE has grown to become a respected conference, drawing participants from across the globe. Prof. Majumder has authored several journal and conference papers, and co-edited two special issues of Transactions in Information Systems (ACM). He has co-edited two books: ‘Multi Lingual Information Access in South Asian Languages’ and ‘Text Processing,’ both published by Springer.