BERT Base Talking heads Gated Gelu
BERT Base Talking heads Gated Gelu is Google's embedding model. A BERT Base text embedding model incorporating talking-heads attention and gated GELU activations for improved representational quality on English text.
Capabilities
Input1/5
Text✓
Image·
Audio·
Video·
PDF·
Output1/5
Text·
Image·
Audio·
Video·
Embedding✓
Capabilities0/13
Reasoning·
Adaptive Reasoning·
Function Calling·
Parallel Function Calling·
Structured Outputs·
Native JSON Schema·
Web Search·
URL Context·
Computer Use·
Code Execution·
File Search·
Prompt Caching·
Assistant Prefill·
Versions
| Version | Released | Context | Input / 1M | Output / 1M | Status |
|---|---|---|---|---|---|
| BERT Base Uncased | — | — | — | — | Available |
| BERT Base Talking heads Gated Gelu | — | — | — | — | Current |
| BERT 2 EN Uncased L-10 H-256 A-4 | — | — | — | — | Available |
| BERT 2 EN Uncased L-10 H-512 A-8 | — | — | — | — | Available |
| BERT 2 EN Uncased L-10 H-768 A-12 | — | — | — | — | Available |
| BERT 2 EN Uncased L-12 H-128 A-2 | — | — | — | — | Available |
| BERT 2 EN Uncased L-12 H-512 A-8 | — | — | — | — | Available |
| BERT 2 EN Uncased L-2 H-128 A-2 | — | — | — | — | Available |
| BERT 2 EN Uncased L-2 H-512 A-8 | — | — | — | — | Available |
| BERT 2 EN Uncased L-2 H-768 A-12 | — | — | — | — | Available |
| BERT Base Cased | — | — | — | — | Available |