Ad
Skip to content
Subscribe Now
AI in practice
Copy the url to clipboard Share this article Go to comment section

Rebuild GPT-2 with OpenAI co-founder Andrej Karpathy

Maximilian Schreiner
Maximilian Schreiner View the LinkedIn Profile of Maximilian Schreiner
Jun 10, 2024

"What I cannot create, I do not understand," Richard Feynman once said. Thanks to a four-hour video by AI researcher Andrej Karpathy, anyone can now recreate GPT-2. In the video, Karpathy shows all the necessary steps from building the GPT-2 network to optimization and training to generating the first text.

The OpenAI co-founder, who was also head of AI at Tesla, left the company after a second round at OpenAI in February 2024 to devote himself to his own projects.

AI News Without the Hype – Curated by Humans

As a THE DECODER subscriber, you get ad-free reading, our weekly AI newsletter, the exclusive "AI Radar" Frontier Report 6× per year, access to comments, and our complete archive.

AI news without the hype
Curated by humans.

  • Over 20 percent launch discount.
  • Read without distractions – no Google ads.
  • Access to comments and community discussions.
  • Weekly AI newsletter.
  • 6 times a year: “AI Radar” – deep dives on key AI topics.
  • Up to 25 % off on KI Pro online events.
  • Access to our full ten-year archive.
  • Get the latest AI news from The Decoder.
Subscribe to The Decoder