Mark Zuckerberg Announces Llama 3 Training and Meta’s AI Plans

ZUSAMMENFASSUNG

In 30 Sekunden

Berman shares a January 2024 video in which Mark Zuckerberg says Meta is training Llama 3 and combining AI research efforts. Zuckerberg describes ambitious future compute targets and a goal of making general intelligence widely available; Berman responds to those plans and miscalculates an illustrative hardware total.

1Research and general intelligenceZuckerberg describes bringing Meta’s AI research efforts closer together.
2Compute targetHe describes a planned 350,000 H100 GPUs and roughly 600,000 H100-equivalent compute by year-end.
3Llama 3Berman highlights Zuckerberg’s statement that the model was then in training.
4Hardware arithmeticThe host’s stated per-chip assumption yields $10.5 billion, before infrastructure costs.

Das Wichtigste

Zuckerberg said in January 2024 that Llama 3 was being trained.
He described responsible openness and useful AI as long-term goals, not a completed AGI release.
His compute figures were targets for the end of 2024.
Berman’s illustrative multiplication of 350,000 GPUs at $30,000 each equals $10.5 billion, not $1 billion.

ThemenOpen-weight models AI History Infrastruktur & Deployment AGI

VOLLTEXT

Den bearbeiteten Text nach Kapiteln lesen

Transkript zeigen

Nur das Transkript

Zuckerberg’s announcement

Zuckerberg discusses Meta’s general-intelligence goals, compute plans and Llama 3 training. He also describes glasses as a possible interface for AI.

Matthew Berman introduces a January 2024 announcement from Meta CEO Mark Zuckerberg, who says Llama 3 is in training. The clip records plans and goals at that moment, rather than a completed general-intelligence system.

Zuckerberg says Meta is bringing its two AI research efforts closer together to support a long-term goal of building general intelligence, making it broadly useful and releasing it responsibly. He identifies reasoning, planning, coding and memory among the capabilities that future assistants and other services would require.

Zuckerberg describes a compute target for the end of the year: around 350,000 Nvidia H100 GPUs, or approximately 600,000 H100-equivalent units of compute including other GPUs. He says Llama 3 is being trained and that Meta has a roadmap of further models; these are company plans as stated in January 2024.

He also sees AI and the metaverse coming together through new devices. In his view, glasses can let an assistant see and hear what the wearer does throughout the day, and he points to the early reception of Ray-Ban Meta glasses.

Berman’s reaction

Berman discusses the significance of the announcement and Meta’s compute investment. His arithmetic for the GPU example requires correction.

Berman highlights the direct confirmation that Llama 3 is in training and recalls the impact of earlier Llama releases on access to models. He views Meta’s statement as evidence of an intensified AI effort alongside its metaverse work. Availability of model weights, commercial permissions and full openness are distinct questions that depend on the relevant license.

Berman emphasizes the scale of Meta’s planned infrastructure and uses an assumed $30,000 per H100 to illustrate cost. His stated total of about $1 billion is an arithmetic error: 350,000 times $30,000 is $10.5 billion, excluding power and cooling. The calculation is illustrative, not evidence of Meta’s actual purchasing prices or expenditure.

Berman concludes that Zuckerberg sees general intelligence as an important goal and hopes Meta can build and openly release it. That is an ambition described in the announcement, not evidence that AGI had been achieved.