Knowledge Graph — Coursera Notes › Academic disciplines › Information Technology / Computer Science › Artificial Intelligence › Large Language Models › Foundation Models
T5
concept · part of Foundation Models
Google model that frames all NLP tasks as text-to-text problems.
T5 uses a unified architecture based on the Transformer encoder-decoder, and it was pre-trained on a massive dataset called C4 (Colossal Clean Crawled Corpus) using a denoising objective where spans of text are masked and predicted.
Connections
- Alternative to GPT
- Related to Text-to-Text Generation
- Related to Data analysis
- Related to Text-to-Text Generation
This is the text view of an interactive 3D knowledge graph — open this page with JavaScript enabled to explore it visually.