T5 question answering

This repository contains the question-answering model code using T5 pre-trained model finetuned on a biomedical dataset.

Dataset

The dataset taken from BioBERT

Requirements

• Python 3x
• PyTorch 1.8.1
• Transformers 4.1.1
• PyTorch Lightning 1.3.0

Source

This repository is modified from these Youtube videos

• Create Custom Dataset for Question Answering with T5 using HuggingFace, Pytorch Lightning & PyTorch
• Fine-Tuning T5 for Question Answering using HuggingFace Transformers, Pytorch Lightning & Python

Thanks to Venelin Valkov