Abstractive Summarization with SimpleT5⚡️

Build your own state-of-the-art abstractive summarizer with simpleT5⚡️ in just 3 lines of code

1. Introduction

In this article, I will show you how to build your own abstractive summarizer with simpleT5 in just couple of lines of code. But what is simpleT5? —

simpleT5 is open-source python framework built on top of PyTorch-lightning⚡️ and Transformers🤗 that lets you quickly train/fine-tune your T5 models. It is super easy to train T5 models on any NLP tasks such as summarization, translation, question-answering, text generation etc.

For this article, we will focus on summarization task and we will see how easy it is to build or train your own abstractive summarizer with simpleT5.

Just — import, instantiate, download a pre-trained model and train.

2. What’s T5 ?