The RedPajama project has released RedPajama-INCITE-7B-Instruct, the highest scoring open model on the HELM benchmarks, outperforming other state-of-the-art open models such as LLaMA-7B, Falcon-7B, and MPT-7B. The instruct-tuned model is optimized for a wide range of tasks and excels in few-shot performance.
RedPajama-INCITE-7B-Chat is available in OpenChatKit and is optimized for chat applications, while RedPajama-INCITE-7B-Base targets full reproducibility with ten checkpoints and a completely open training process. The whole RedPajama-INCITE family is clean for commercial use.
Sources: