StarCoder2 is a free code model trained on over 600 programming languages
ServiceNow, Hugging Face, and Nvidia have released StarCoder2, a family of open-access code generation LLMs. StarCoder2 was developed in collaboration with the BigCode community as a successor to Starcoder, which was released in May 2023 and trained on 619 programming languages. StarCoder2 offers three model sizes: a 3 billion parameter model from ServiceNow, a 7 billion parameter model from Hugging Face, and a 15 billion parameter model from Nvidia.
StarCoder2 has been trained on the new Stackv2 code dataset, which is also available. New training methods are designed to help the model better understand low-resource programming languages, mathematics, and source code discussions. The model can be fine-tuned by companies for their own tasks.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
Subscribe nowRead on for the full picture.
Subscribe for hype-free coverage.
- Full access to every article on THE DECODER
- No ads
- Join the comments and community discussions
- A weekly AI news recap via mail
- 6x/year: "AI Radar" — deep dives on the AI topics that matter most
- Daily AI news, always up to date
- Our full ten-year archive
- Covered by a team with 10+ years in AI