Meta introduced the launch of Llama 3, the most recent model of its giant language mannequin (LLM), on April 18, describing it as a “main leap over Llama 2.”
The corporate stated it has initially launched the primary two fashions of the present model, that includes 8B and 70B parameters, with upcoming fashions slated to function 400B parameters.
Meta emphasised Llama 3 was educated with a “giant, high-quality coaching dataset” that includes over 15 trillion tokens, 7x bigger than Llama 2 and that includes 4x extra code. Llama 3 additionally options filtering strategies, together with NSFW filters, to make sure knowledge high quality.
LLama 3 outperforms Llama 2 and competing fashions resembling Anthropic’s Claude Sonnet, Mistral Medium, and OpenAI’s Chat GPT-3.5 greater than half the time throughout 12 use instances.
The primary releases of Llama 3 are text-based fashions. Nonetheless, future releases will likely be multilingual and multimodal. They can even function longer context and show higher efficiency in reasoning and coding, which Meta described as “core LLM capabilities.”
The corporate plans to deploy Llama 3 on all main cloud suppliers, mannequin API suppliers, and different companies. It plans to launch the product “in every single place.”
Broader consumer entry
Llama 3 is geared toward builders, however Meta has additionally launched new methods for finish customers to entry AI companies within the US and greater than 12 different international locations.
One new addition is a devoted web site referred to as Meta AI, the place customers can entry AI-powered writing help, trivia video games, simulated job interviews, and homework assist.
Meta has additionally built-in Meta AI with all its merchandise, together with Fb, Instagram, WhatsApp, and Messenger. Moreover, the corporate provides the service by way of Ray-Ban Meta good glasses within the US and plans to increase it to its Meta Quest VR headset.
In an announcement, CEO Mark Zuckerberg stated:
“We imagine that Meta AI is now probably the most clever AI assistant you could freely use.”
Information of Meta’s expanded AI merchandise comes shortly after upgrades to competing companies. ChatGPT upgraded to GPT-4 Turbo on April 11, whereas Microsoft Copilot upgraded to GPT-4 Turbo beginning in March, advancing the race between consumer-oriented AI companies.
