We moved from training AI, to running it. Now we let it act.
01
Training
02
Inference
03
Automation
Reasoning›Execution
Definitions
What an agent is, and what it is not.
Chatbot
Answers your questions.
Co-pilot
Helps you do the work.
Workflow
Runs a fixed script.
LLM
+
Workflow
+
API
=
Agent
Context window
Context windows are finite
Actual Context Window 1M
Tool Definitions2.5M
System Prompt2K
Task3K
Conversation8K
Tool calling
Post-mortem injection
Tool use is bolted on after the model is trained. It never actually learned these APIs, so it guesses.
Functional overlap
When tools expose similar schemas, the model blends them and invents parameters that do not exist.
11
placeholder image · swap later
But LLMs are very good at one thing: writing code.
The pivot
They are bad at calling tools. They are great at one thing: writing code.
Calling tools directly
model→charge_invoice({…})
✕ wrong parameter, the task breaks
Writing code
// charge every overdue invoiceconst overdue = await db.query("due < now() AND !paid")
for (const inv of overdue) {
const r = await billing.charge(inv)
if (!r.ok) awaitretry(inv)
}
✓ runs, retries, completes
Models are fluent in code. They only guess at your APIs.
One program loops, branches, and retries. A broken tool call just stops.
The tools never enter the context window.
So where does that code run, for hours or even days?
10,000 agents, each active 1% of the time. Pay for all 10,000, or just the 100 doing the work.
For enterprises
An agent is an identity. Secure it like one.
The same questions you would ask any new hire with a key.
Who is it?
A governed identity, not a script run from a laptop.
Which doors open?
Only the systems its job needs. Nothing else.
What did it touch?
Every action authenticated and logged.
Can you shut it off?
Revoke access and it stops mid-task, instantly.
Beyond the demo
Each answer leads to the next.
Context windows overflow. Tool calls break.
→
Have the model write code.
↓
A durable execution environment: sandboxes and state.
←
Code must run somewhere. The agent must remember.
↓
Now it can reach your tools and internal systems.
→
Zero Trust and MCP governance.
“I know what hyperscalers will look like in 10 years: exactly the same as they do now. I'm looking to Cloudflare to define what the next generation cloud looks like.”