ptt5-v2: A Closer Look at Continued Pretraining of T5 Models for the Portuguese Language
- 30 January 2025
- book chapter
- Published by Springer Nature
- p. 324-338
Abstract
No abstract availableKeywords
All Related Versions
This publication has 15 references indexed in Scilit:
- Advancing Neural Encoding of Portuguese with Transformer Albertina PT-*2023
- Sabiá: Portuguese Large Language Models2023
- AfriTeVA: Extending ?Small Data? Pretraining Approaches to Sequence-to-Sequence Models2022
- AraT5: Text-to-Text Transformers for Arabic Language Generation2022
- Pyserini: A Python Toolkit for Reproducible Information Retrieval Research with Sparse and Dense Representations2021
- Leveraging emoji to improve sentiment classification of tweets2021
- mT5: A Massively Multilingual Pre-trained Text-to-Text Transformer2021
- BERTimbau: Pretrained BERT Models for Brazilian Portuguese2020
- Document Ranking with a Pretrained Sequence-to-Sequence Model2020
- Unsupervised Cross-lingual Representation Learning at Scale2020