Ad
Skip to content

Meta's internal memo signals AI comeback after rocky year

Image description
Midjourney prompted by THE DECODER

Meta has finished pretraining its new AI model codenamed "Avocado," according to an internal memo.

The model is the company's most capable pretrained base model, The Information reports, citing an internal document. Pretraining is the first phase of AI development, where a model learns basic patterns and relationships from large amounts of data.

Avocado outperforms the best freely available base models, according to the memo from Megan Fu, a product manager at Meta Superintelligence Labs. In knowledge, visual perception, and multilingual performance, it can even compete with leading fully trained models - even though Avocado hasn't gone through the second training phase yet. This phase, called post-training, refines models for specific tasks.

The model also uses computing power far more efficiently: ten times more efficient than Maverick and a hundred times more efficient than Behemoth, two earlier Meta models. Meta achieved these gains through better training data, improvements to the technical foundation, and changes to the training method.

Avocado could validate Zuckerberg's billion-dollar AI bet

These advances matter for Meta, which had significant problems with its Llama 4 model in 2025. The release was delayed multiple times, benchmarks were manipulated, and developers were disappointed with performance after launch. These struggles led to a major reorganization of the AI division, including Yann LeCun's departure. Meta invested $14.3 billion in the startup Scale AI and brought in its CEO Alexandr Wang to lead a new AI unit called Meta Superintelligence Labs.

Meta is now pouring record amounts into its AI efforts: for 2026, the company expects capital expenditures between $115 and $135 billion - about 73 percent more than 2025. CTO Andrew Bosworth recently said at the World Economic Forum in Davos that Meta's AI models are very good but still need significant post-training. CEO Mark Zuckerberg echoed this view at the last earnings call. Meta plans to release new models steadily throughout the year. According to rumors, Meta will move away from the open-source approach of its Llama models with Avocado. A model focused on visual applications with the codename Mango is also in development.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Read on for the full picture.
Subscribe for hype-free coverage.

  • Access to all THE DECODER articles.
  • Read without distractions – no Google ads.
  • Access to comments and community discussions.
  • Weekly AI newsletter.
  • 6 times a year: “AI Radar” – deep dives on key AI topics.
  • Up to 25 % off on KI Pro online events.
  • Access to our full ten-year archive.
  • Get the latest AI news from The Decoder.
Subscribe to The Decoder