"What I cannot create, I do not understand," Richard Feynman once said. Thanks to a four-hour video by AI researcher Andrej Karpathy, anyone can now recreate GPT-2. In the video, Karpathy shows all the necessary steps from building the GPT-2 network to optimization and training to generating the first text.

Ad

The OpenAI co-founder, who was also head of AI at Tesla, left the company after a second round at OpenAI in February 2024 to devote himself to his own projects.

Ad
Ad
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.
Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:
Bank transfer
Max is managing editor at THE DECODER. As a trained philosopher, he deals with consciousness, AI, and the question of whether machines can really think or just pretend to.
Join our community
Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.