Meta introduces Llama 3, which will be available in WhatsApp and Instagram, among others – IT Pro – News

Meta has presented the third generation of its Llama AI model. The current versions have 8 billion and 70 billion parameters, and a larger model with 400 billion parameters will follow later. He is still training.

Llama 3’s training dataset is seven times larger than last year’s Llama 2, claims Meta. There is four times as much code in the data. In addition, the tokenizer for encoding language is much more efficient, which should lead to better performance. Meta also uses something called ‘grouped query attention’ to improve efficiency.

Among the training data, 95 percent are in English, which leads to reduced performance in the thirty other languages ​​that Meta AI supports. Llama 3 will now be available in services such as WhatsApp and Instagram, the company claims. This happens in the form of a AI-assist. This currently only happens in English, in the United States, Australia, Canada, Ghana, Jamaica, Malawi, New Zealand, Nigeria, Pakistan, Singapore, South Africa, Uganda, Zambia and Zimbabwe.