Talking Heads Large is Google's language model. A large text classification model using the Talking Heads attention mechanism for improved multi-head attention in transformer architectures.
Capabilities
Input1/5
✓
·
·
·
·
Output1/5
✓
·
·
·
·
Capabilities0/13
·
·
·
·
·
·
·
·
·
·
·
·
·
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| Talking Heads Large | — | — | — | — | Current |
| Talking Heads Base | — | — | — | — | Available |