← Back to blog

· Timothy O'Brien

Chapter 4, “Orchestration in Practice,” is available

A product manager asks for a saved-search feature. At 2:14 in the morning, checkout errors spike. Those are ordinary moments, and they are where this book needed to go next.

Chapter 4, “Orchestration in Practice,” is now available. It is the chapter where the argument leaves pure definition behind and shows the work itself: what an orchestrator actually does with the tools that exist today, what changes when several delegated systems are connected on purpose, and why this is not only a software story.

Chapter 3 named the parts of an orchestrated system. Chapter 4 runs them.

The chapter covers three things. First, where orchestration exists right now: in software development, in systems such as Gas Town and Gas City, in frameworks such as CrewAI and LangGraph, and in the open-source kits the large platforms have shipped. Second, what one ordinary piece of work looks like when an orchestrator runs it, from preparation beforehand to the run itself to the review at the end. Third, what can actually be built today with skills, memory, evals, traces, policy formats, and topology standards, along with the governance gaps those artifacts still leave behind.

The opening section refuses a bad boundary. Software is where these coordination problems were solved first, but the problems are not software-specific. Once several agents work in parallel toward one outcome, the same questions appear everywhere: who owns a task, what state survives, how a stuck worker is detected, how work is merged, and how a person knows what is happening. The vocabulary changes across operations, compliance, logistics, healthcare, finance, and public services. The structure does not.

The middle of the chapter is the part many readers will go to first: Developer A versus Orchestrator B, both handed the same website change, both responsible for the same result.

> “The point is not that one way is materially better than the other.”

That line matters. The chapter is not staging a morality play about old work and new work. It is drawing a cleaner distinction. Developer A uses an AI coding agent, reviews the output, writes tests, answers questions, watches the deploy, and holds the sequence together by personal attention. The agent is faster. “The sequence is the same.” Orchestrator B front-loads the effort into system design: agents, handoffs, permissions, memory, checks, disagreements, evidence, and the points where a human must decide. Then the feature request can move through a connected system that plans, implements, tests, reviews, and prepares a release in parallel.

That is a different job.

The chapter is careful not to turn that difference into hype. Preparation takes real time. The first change may cost about what it would have cost the ordinary way. The return shows up later, when the system is already prepared for the second change, and the fiftieth. Orchestrated systems do not create free work. They move work into design, boundaries, and review.

Then the chapter widens the lens again. The same idea appears in incident response. Instead of waking people up to reconstruct a failure from six dashboards and two layers of paging, the system is already watching: one agent reads traces, one checks the provider status page, one compares recent deploys, and one drafts a customer message for human approval. Diagnosis arrives with evidence attached. The system still stops for a human before acting. That boundary matters, as does the fact that the operational loop can be designed in advance rather than improvised at 2:14 in the morning.

The later sections get concrete fast. They look at:

  • Skills: SKILL.md, procedural memory, and the difference between a skill and a tool.
  • Memory: MEMORY.md, USER.md, Letta blocks, and why inspectable memory becomes a liability issue when it matters.
  • Evals: datasets and task suites that treat regression as engineering rather than vibes.
  • Traces and audit: OpenTelemetry GenAI, OpenInference, Temporal history, and the gap between debugging and governance.
  • Permissions: MCP as connectivity, ACS as a portable permission envelope, and why neither solves ownership by itself.
  • Topology: A2A Agent Cards, discovery across agents, and the unresolved question of authority after handoff.

This part of the chapter does not confuse formats with answers. Skills help, but they are not authority. Memory helps, but it is not policy. Evals help, but they are not an operating record. Traces help, but they are not a decision standard. Permissions and topology help, but they do not tell anyone who owns the action when the consequence lands outside the system.

That is the deeper thread running through the whole chapter. Orchestration is not just parallel agents and better tooling. It is the design of a loop under human authority.

An open book, built in public

There is another experiment happening alongside the writing. I am releasing this book in the open, one chapter at a time, so readers can see the argument develop rather than waiting for a finished object to appear at the end.

The book will be freely available on the web, with downloadable ePub and PDF versions. It will eventually be available in print for readers who prefer that format. I expect it will take at least another two months to reach what I consider a final version of the First Edition, and there will be many updates along the way.

If you want to stay current, join the email distribution list. The commitment there is simple: it will not feel like promotion. It will be a way to know when another chapter is available, when something has changed, and when the book has moved another step forward.

Chapter 4 is where the book stops naming parts and starts running them. Read it for the saved-search feature, the 2:14 incident, and the concrete stack. Continue with the book for the harder question underneath all of it: who designed the system, who set the boundaries, and who owns the decision when it acts?

---

HQ 7 — Guided. I led the structure and key sections; AI filled gaps, smoothed transitions, and expanded points.

This chapter is part of the larger argument about the transition from programmer to orchestrator in The Orchestrator.

Keep reading
This post is part of the thinking behind The Orchestrator — a field guide to delegating real work to AI agents, without losing the thread.