LLM OS
The LLM OS is Andrej Karpathy‘s framing of large language models not as chatbots or word generators, but as the kernel process of an emerging operating system — a new computing paradigm analogous to traditional operating systems but built around language models as the central processing element.
The analogy
| Traditional OS | LLM OS |
|---|---|
| Kernel process | LLM |
| RAM (working memory) | Context Window |
| Disk / internet (storage) | Training data + RAG-accessible documents |
| Peripherals | Tools: web search, calculator, Python, image generation |
| Multi-threading | Multiple LLM instances / agent chains |
| User space / kernel space | System prompt (operator) / user turns |
| Windows / macOS (proprietary) | GPT series, Claude series, Gemini series |
| Linux (open-source) | Llama series, Mistral, DeepSeek |
What this framing adds
The chatbot framing focuses on conversation. The OS framing focuses on computation — on the LLM as an orchestrator of tools, memory, and sub-processes. In this view:
- The LLM doesn’t just answer questions; it pages information in and out of context, delegates computation to specialised tools, and coordinates multi-step workflows.
- The context window is RAM: precious, finite, and swept clean when a session ends (like rebooting).
- Tools are peripherals: web search is the network stack; the Python interpreter is a compute co-processor.
Utilities, fabs, and the 1960s
In his 2025 keynote at YC’s AI Startup School (Andrej Karpathy on Software 3.0, LLMs as Operating Systems, and Partial Autonomy), Karpathy tests the operating-system analogy against two others. An LLM lab resembles a utility: capital spent on training is like building a grid, access is metered per token, and users demand latency, uptime and consistent quality — so when leading models go down, ‘it’s actually kind of like an intelligence brownout in the world.’ It also resembles a chip fab, because training capital is large and research know-how is concentrating inside the labs. The operating system still fits best, because what the labs ship are complex software ecosystems, not commodities.
He places the LLM OS in the 1960s of computing: compute is too expensive to own, so it is centralised in the cloud and time-shared, users are thin clients, and the interface is a text terminal, with no general graphical interface yet. One feature has no precedent: the technology diffused to consumers before governments and corporations, the reverse of electricity, computing or GPS.
Evolution into Software 3.0
The LLM OS framing (introduced in Intro to Large Language Models, Nov 2023) prefigures the Software 3.0 framing (articulated in From Vibe Coding to Agentic Engineering, 2025). The LLM OS describes the architecture; Software 3.0 describes the programming paradigm that uses that architecture.