Llama 4 Behemoth

Meta Released April 2025

Meta's flagship multimodal model (RESEARCH PREVIEW ONLY - weights not publicly released)

Llama 4 Behemoth

MetaApril 2025

Training Data

Up to August 2024

Llama 4 Behemoth

April 2025

Parameters

~2 trillion (288B active)

Training Method

Mixture of Experts

Context Window

1,000,000 tokens

Knowledge Cutoff

August 2024

Key Features

Research Preview • Massive MoE Architecture • Multimodal • Not Publicly Released

Capabilities

Reasoning: Outstanding

STEM: Outstanding

Complex Tasks: Outstanding

What's New in This Version

Massive MoE model with 16 experts - announced April 2025, weights not yet publicly available

Meta's flagship multimodal model (RESEARCH PREVIEW ONLY - weights not publicly released)

What's New in This Version

Massive MoE model with 16 experts - announced April 2025, weights not yet publicly available

Technical Specifications

Parameters ~2 trillion (288B active)
Context Window 1,000,000 tokens
Training Method Mixture of Experts
Knowledge Cutoff August 2024
Training Data Up to August 2024

Key Features

Research Preview Massive MoE Architecture Multimodal Not Publicly Released

Capabilities

Reasoning: Outstanding
STEM: Outstanding
Complex Tasks: Outstanding
Theme
Language
Support
© funclosure 2025