TX_011· AI
Meta's Llama 4 family: 10M-token context, MoE architecture, fully open
Llama 4 ships with two open-weight models: Scout (17B active / 109B total, 10M context) and Maverick (400B parameters). MoE replaces dense transformer. Largest open context window on the market.