Rebuild GPT-2 with OpenAI co-founder Andrej Karpathy

Max is the managing editor of THE DECODER, bringing his background in philosophy to explore questions of consciousness and whether machines truly think or just pretend to.

Profile

E-Mail

"What I cannot create, I do not understand," Richard Feynman once said. Thanks to a four-hour video by AI researcher Andrej Karpathy, anyone can now recreate GPT-2. In the video, Karpathy shows all the necessary steps from building the GPT-2 network to optimization and training to generating the first text.

The OpenAI co-founder, who was also head of AI at Tesla, left the company after a second round at OpenAI in February 2024 to devote himself to his own projects.

Join our community

Join the DECODER community on Discord, Reddit or Twitter - we can't wait to meet you.

Support our independent, free-access reporting. Any contribution helps and secures our future. Support now:

Bank transfer

Maximilian Schreiner

Max is the managing editor of THE DECODER, bringing his background in philosophy to explore questions of consciousness and whether machines truly think or just pretend to.

Profile

E-Mail