Karpathy's video: building GPT, a Transformer tutorial from scratch - AI Dynamics

Skip to content

AI Dynamics

Global AI News Aggregator

Rechercher

Karpathy’s video: building GPT, a Transformer tutorial from scratch

By

–

17 January 2023 22h07

Great new video from @karpathy
: "Let's build GPT", a tutorial on coding a Transformer model from scratch:

→ View original post on X — @goodside

17 January 2023

AI CODE GENERATIVE AI LLMS MACHINE LEARNING OPEN SOURCE RESEARCH

←Memorization vs Learning Distribution in AI Models

Clip of Andrej’s hand-coded GPT model trained on Shakespeare→

MORE ARTICLES

Disable memories in Codex via /memories

25 June 2026
AI agent NEWTON uses keyframes and simulators to enforce physics

25 June 2026
Humanity’s immune response to mediocre AI content

25 June 2026
Google Flow Agent generates images and videos via Street View in US

24 June 2026

INNOVATION GENERATIVE AI RESEARCH LLMS TOOLS MACHINE LEARNING CODE MARKET TRENDS BUSINESS TECHNOLOGY BIG TECH ETHICS ENTERPRISE AI SOFTWARE AGENTS APPS AUTOMATION COMPUTING DATA POLICY OPEN SOURCE CULTURE MULTIMODAL AI REGULATION CREATIVE AI PROMPT ENGINEERING ECONOMY SOCIETY SAFETY INVESTMENT EDUCATION AI HARDWARE AGI HARDWARE JOBS STARTUPS INDUSTRY ROBOTICS WORKFORCE SECURITY CYBERSECURITY HEALTHCARE AI SYSTEMS SUSTAINABILITY WEB3 DECENTRALIZED AI

AI Dynamics

Global AI News Aggregator

About
Archives

Rechercher