Foundation Models · since 2024
State-Space Hybrid
State-space (Mamba) architectures combined with attention — challenging pure transformers on long-context efficiency. NOT anticipated: the hybrid shipped in 2024 (Jamba, Zamba, Falcon Mamba). The likely shape of the successor backbone is a hybrid (attention + SSM + MoE), not a clean replacement; pure attention is being eroded, not deposed.
4
events traced
4
source records
30 Jun 2026
first signal
9 Jul 2026
last activity
Who drove it
Key movements
2024★
first production hybrid (Jamba)
256K↑
context on one 80GB GPU
shipping↑
linear-time long context
The story, event by event
Every point below is traced to a real source — nothing on this page is invented.
1 Dec 2023impact 72
Mamba — selective state-space models
value: linear-time; metric: scaling
28 Mar 2024impact 78
Jamba — first production Mamba+attention+MoE hybrid
value: 256K; metric: context
12 Aug 2024impact 64
Zamba & Falcon Mamba follow
value: shipping; metric: class
22 Jan 2026impact 60
Introduction of D4RT Model for 4D Scene Reconstruction
efficiency: 300x compared to previous methods; architecture: Unified encoder-decoder Transformer
Lineage
Descended from
This is one node. The map holds the whole field.
Watch State-Space Hybrid — and everything it connects to — grow as real news threads onto the map every day.