Meta Introduces Advanced AI Model Llama 3.1
Meta Platforms Inc., the parent company of Facebook, has launched an advanced AI model named Llama 3.1, which CEO Mark Zuckerberg hailed as "state of the art" with the potential to compete with industry giants like OpenAI and Google's Alphabet Inc. The announcement came on Tuesday, marking a significant update from the Llama 3 model released in April.
In an interview, Zuckerberg underscored the importance of intelligence in AI assistants, stating that Meta's Llama models rank among the world's most sophisticated. The company is already working on the next iteration, Llama 4. The new model boasts a wide array of capabilities, such as improved reasoning skills for complex problem-solving and the ability to synthesize extensive texts. Additionally, it includes generative AI features for creating images based on text prompts. One standout feature, "Imagine Yourself," allows users to upload their images to create varied scenarios and scenes.
Llama models power Meta's AI chatbot, Meta AI, which is integrated into apps like Instagram and WhatsApp and also available as a standalone web product. With "hundreds of millions" of users, Zuckerberg predicts Meta AI will become the most widely used chatbot by year-end. He also expects external developers to adopt Llama for training their AI models, positioning it as a foundational tool for the industry.
The development of Llama 3.1 required several months and hundreds of millions of dollars in computing power. Zuckerberg anticipates that future models will necessitate even more significant investments, escalating to billions in computing costs. Despite previous efforts to streamline operations and cut costs, Meta continues to invest heavily in AI, viewing it as pivotal for the next decade.
Meta offers the Llama technology for free under an "acceptable use policy," aiming to foster innovation and potentially shape industry dynamics. Zuckerberg emphasized the importance of Meta being able to develop technology independently rather than relying on competitors. However, the data sets used to train Llama 3.1 remain confidential, with Meta using a combination of public posts from Facebook and Instagram and other licensed proprietary data.
Despite the open-access approach, critics express concerns about potential misuse or the advantage it might give to international tech competitors, particularly from China. Zuckerberg countered these arguments, advocating for open and decentralized innovation, which he believes drives progress and leadership. He argued that locking down the technology would be counterproductive and emphasized the strategic advantage even a small lead in AI development could provide over time.
Meta's significant AI investment includes plans to acquire around 350,000 Nvidia Corp. H100 GPUs by the end of the year, underpinning the training of large language models like Llama and OpenAI's ChatGPT. These H100 chips are crucial for AI advancements and come with high costs.
Zuckerberg concluded by asserting that while the US might not maintain a years-long lead over China in AI, even incremental advancements can significantly impact long-term leadership. This perspective reinforces Meta's commitment to substantial investment and innovation in the AI domain.