Llama

The amount of research they have shared in it is insane. You can read the paper here and listen to the Latent Space podcast with Thomas Scialom (Llama 2 lead and Llama 3 post-training lead) for more technical details.  

Fireworks AI has the best pricing $3/$3 for input/output for a million tokens. For the 8B and 70B versions, Octo AI and Together AI have the best pricing right now.  

Meta isn’t just releasing powerful models for developers, it is integrating them directly into meta.ai. Users of Meta’s AI chatbot will now have access to Llama 3.1 405B.  

2. “Imagine me” feature creates personalized images based on text prompts and your selfies (e.g., “Imagine me as a superhero”). This uses other research from Meta (not Llama) to make it possible.

Zuckerberg thinks:

Zuck’s BHAG (Big Hairy Audacious Goal) is to have Meta AI be the most used AI chatbot in the world by the end of the year. He says it will get there before that. More changes are coming to Meta AI, some highlights:  

• Meta will not make money by selling access to the models, but create products that use these AI models. At the same time, he doesn’t want to rely on others for access to the platform (like Apple in mobile phones).
• Open innovation is key to staying ahead of competitors like China (not centralized progress). The US can maintain a healthy 6-8 months lead with open AI models and it would be better than hoping that model weights of closed AI models remain secret.