nanoT5 – Fast & Simple repository for pretraining and finetuning T5-style models A code repository for pretraining and finetuning T5 LLMs(one of the earliest encoder-decoder models) under a limited budget. – Achieves 40.7 RougeL in 16 hrs on a single GPU(original T5 on Hugging
nanoT5: Fast T5 Model Pretraining and Finetuning on Single GPU
By
–
