Future of Product #4 · Amsterdam
AI Agents:Beyond the Demo.
Margot Schipper · Senior Account Executive · Cloudflare
The shift
We moved from training AI, to running it.
03
Automation
Reasoning › Execution
Anatomy of an agent
AI
+
Workflows
+
Tools
=
Agent
DEMO
Prompt › Model › Tool call › Response one pass, no memory, no retries
PRODUCTION
Multi-agent orchestrationManager delegates: analyst, checker, planner
Feedback loopUser satisfaction: retry until yes
Interpretation
Context window
Context windows are finite.
Tool Definitions2.5M
System Prompt2K
Task
Conversation8K
Tool definitions alone exceed the entire window.
Tool calling
Post-mortem injection Tool use is bolted on after the model is trained. It never actually learned these APIs, so it guesses.
Functional overlap When tools expose similar schemas, the model blends them and invents parameters that do not exist.
11
placeholder image · swap later
But LLMs are very good at one thing: writing code.
Code needs a harness. The harness needs an environment.
Chat Voice Email
Slack Webhook
GLOBAL NETWORK · authenticated entry
Model gateway: caching, fallback, rate & spend limits, analytics
AI Gateway ↗
EXECUTION ENVIRONMENT · runs on V8 isolates, 0ms cold start
The economics
The architecture that changes the economics.
Containers
✕ Always running
✕ Billing for idle
✕ Cold start: seconds
✕ OS, runtime, ops burden
✕ 10K agents = 10K instances
✓ 0ms cold start
✓ $0 when idle
✓ No OS, no runtime
✓ Nothing to manage
✓ 10K agents at 1% active = pay for 100
100× more efficient. Built in 2017, not for agents. Agents turned out to need exactly this.
For enterprises
Security is not a bolt-on. It is the prerequisite.
Unmanaged servers become governed, OAuth-scoped endpoints.
Every agent request authenticated. Revoke, it stops instantly.
One layer for cost, caching, and compliance on every model call.
“I know what hyperscalers will look like in 10 years: exactly the same as they do now. I'm looking to Cloudflare to define what the next generation cloud looks like. ”
Mark Smith · Head of Infrastructure · Discord
Questions?
Come find me, I would love to chat.
Margot Schipper · Senior Account Executive · Cloudflare