Layers / Attention¶
Sections¶
Classes¶
| Class | Description |
|---|---|
| AttentionConfig | Configuration for multi-head and grouped-query attention with optional rotary embeddings |
| Class | Description |
|---|---|
| AttentionConfig | Configuration for multi-head and grouped-query attention with optional rotary embeddings |