Ad
Skip to content

RedPajama 7B is a capable open-source AI model now available

The RedPajama project has released RedPajama-INCITE-7B-Instruct, the highest scoring open model on the HELM benchmarks, outperforming other state-of-the-art open models such as LLaMA-7B, Falcon-7B, and MPT-7B. The instruct-tuned model is optimized for a wide range of tasks and excels in few-shot performance.

RedPajama-INCITE-7B-Chat is available in OpenChatKit and is optimized for chat applications, while RedPajama-INCITE-7B-Base targets full reproducibility with ten checkpoints and a completely open training process. The whole RedPajama-INCITE family is clean for commercial use.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Read on for the full picture.
Subscribe for hype-free coverage.

  • Access to all THE DECODER articles.
  • Read without distractions – no Google ads.
  • Access to comments and community discussions.
  • Weekly AI newsletter.
  • 6 times a year: “AI Radar” – deep dives on key AI topics.
  • Up to 25 % off on KI Pro online events.
  • Access to our full ten-year archive.
  • Get the latest AI news from The Decoder.
Subscribe to The Decoder