Base-2, a next-generation AI model with 2.8 trillion total parameters. The model was trained for 38 days on 16,000 Nvidia GB200 GPUs and employs a mixture-of-experts architecture that activates only ...