Ad
Skip to content
Subscribe Now
Plus AI in practice
Copy the url to clipboard Share this article Go to comment section

Rebuild GPT-2 with OpenAI co-founder Andrej Karpathy

Maximilian Schreiner
Maximilian Schreiner View the LinkedIn Profile of Maximilian Schreiner
Jun 10, 2024

"What I cannot create, I do not understand," Richard Feynman once said. Thanks to a four-hour video by AI researcher Andrej Karpathy, anyone can now recreate GPT-2. In the video, Karpathy shows all the necessary steps from building the GPT-2 network to optimization and training to generating the first text.

The OpenAI co-founder, who was also head of AI at Tesla, left the company after a second round at OpenAI in February 2024 to devote himself to his own projects.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

Read on for the full picture.
Subscribe for hype-free coverage.

  • Full access to every article on THE DECODER
  • No ads
  • Join the comments and community discussions
  • A weekly AI news recap via mail
  • 6x/year: "AI Radar" — deep dives on the AI topics that matter most
  • Daily AI news, always up to date
  • Our full ten-year archive
  • Covered by a team with 10+ years in AI
Subscribe to The Decoder