THE FUTURE MARKETACADEMY
Your classroomRoom 01 · AI Lab
School of AI

Agent Systems: design, test and govern agents at scale

What you'll be able to do
  • Decide when a job needs several agents and when one agent (or a plain workflow) is the better, cheaper choice.
  • Design a lead agent with subagents, write clear delegation briefs and give each subagent only the tools it needs.
  • Build an evaluation suite: tasks, trials, graders, pass@k and pass^k, capability tests and regression tests.
  • Layer permissions so that no single rule is the only thing between an agent and a mistake.
  • Monitor a running system with logs, traces, hooks and the usage and cost reports.
  • Control cost with step limits, budget caps, spend limits, workspaces and caching.
  • Write an agent safety and incident-response plan, and lead a review of it with other people.

Before this course: Multi-Step Agents: tools, memory and reliability (course 1.4.3). You should already be able to write the manual agent loop (tool_use, tool_result, stop_reason), design several tools with clear descriptions, return helpful errors, keep memory in files, set step limits, add a human approval step and test a loop with a stand-in client. Courses 1.4.1 (Agents First Steps) and 1.4 (Build AI Agents with Claude) come before that. This course is the expert level: you stop building one agent and start designing, testing and governing a system of agents that other people depend on. You will also learn to teach it to a team. You need Python 3.9 or newer and a terminal. Code marked "tested" was run for this course with plain Python and no API key. Code marked "from the docs" is shown as Anthropic documents it and was not run here, because it needs an API key.

Words in this course 77Open the Vocabulary Hall
01

One agent or many? Choose the simplest thing that works

In simple words

A small bakery needs one baker. A huge wedding order may need a head chef who hands out jobs: one person on cakes, one on bread, one on icing. But more cooks cost more money, and they need to talk to each other. So before hiring more cooks, ask: is one good cook enough?

Key facts
  • Anthropic's article "How we built our multi-agent research system" describes an orchestrator-worker pattern: a lead agent plans the work and sends subagents to do parts of it in parallel. Subagents search, check results and report back to the lead.
  • In that system, the multi-agent version beat a single agent on Anthropic's internal research evaluation by 90.2 percent. The article also says that agents use about 4 times the tokens of a chat, and multi-agent systems about 15 times the tokens of a chat. (These are the figures from that article, for that system. Your numbers will differ. Measure your own.)
  • The article's conclusion: multi-agent systems pay off for high-value tasks that split into many independent parts. They are a poor fit when the work has many dependencies between steps, such as many coding tasks.
  • From Anthropic's "Building effective agents" guide: start with the simplest solution and add complexity only when it clearly improves results. Many jobs need only a single call, or a fixed workflow, and not an agent at all.
  • The article gives effort rules of thumb: a simple fact-finding job needs 1 agent and about 3 to 10 tool calls; a direct comparison needs 2 to 4 subagents with about 10 to 15 calls each; complex research can use more than 10 subagents. Tell the lead agent how much effort a question deserves, or it may over-spend.
  • Claude Opus 5 delegates to subagents more readily than earlier models, according to the Agent SDK docs. That makes depth, concurrency and spend limits (Lesson 6) more important.
QuestionIf yesIf no
Can the job be split into parts that do not need each other's results?Subagents in parallel may helpKeep one agent, steps in order
Is the result valuable enough to pay several times the tokens?Multi-agent may be worth itUse a single agent or a fixed workflow
Does one part produce huge amounts of text the rest does not need?A subagent keeps that text out of the main contextNo need
Can you measure whether the system is better? (Lesson 3)Try it and compareDo not build it yet
Step by step
  1. Write the job in one sentence and list its parts on paper.
  2. Mark each pair of parts as "independent" or "depends on".
  3. Estimate the value of a good result and how often the job runs.
  4. Build the simplest version first: one prompt, then a fixed workflow, then one agent. Write down how well each does on five sample inputs.
  5. Only if one agent clearly fails (too slow, context too full, quality too low), sketch a lead agent with two subagents.
  6. Write the decision in one paragraph: what you chose, what you rejected and why.
  7. Check: someone who was not in the room can read your paragraph and say why you did or did not use several agents.
Watch on YouTube
Building more effective AI agentsAnthropic · YouTube · youtube.com
Building the future of agents with ClaudeAnthropic · YouTube · youtube.com

Videos by other creators on YouTube, for reference. They are not made by or affiliated with The Future Market.

LESSON 01One agent or many? Choose the simplest thing that works
LESSON 01 / ANIMATED LESSON / AI VOICE00:00 / 01:10
Read the video script
[Host] "More agents is not the same as better. It is the same as more cost."
[Text on screen: Lead agent + parallel subagents] "Anthropic's research system uses a lead agent that hands parts of a job to subagents."
[Text on screen: About 4x tokens for an agent, about 15x for many] "In their article, that cost about 15 times the tokens of a chat."
[Screen: the decision table] "Use several agents when the parts are independent and the result is worth the cost."
[Host] "Start with the simplest thing that works. Add agents only when you can show they help."
Try it now

Take a job from your own work or study (for example "prepare a weekly report from five sources"). Fill in the decision table, build the simplest version, and write the one-paragraph decision. Do not build the multi-agent version yet.

ClaudeStuck? Copy a ready-made prompt for Claude

Copy this, open Claude, paste it, and Claude will walk you through the lesson step by step.

For a grown-up: Claude is for adults (18+). Copy this, paste it into Claude, and use the answer to explain the lesson to your child.

I'm learning "Agent Systems: design, test and govern agents at scale" on The Future Market. Lesson 1: "One agent or many? Choose the simplest thing that works".

What the lesson teaches:
- Anthropic's article "How we built our multi-agent research system" describes an orchestrator-worker pattern: a lead agent plans the work and sends subagents to do parts of it in parallel. Subagents search, check results and report back to the lead.
- In that system, the multi-agent version beat a single agent on Anthropic's internal research evaluation by 90.2 percent. The article also says that agents use about 4 times the tokens of a chat, and multi-agent systems about 15 times the tokens of a chat. (These are the figures from that article, for that system. Your numbers will differ. Measure your own.)
- The article's conclusion: multi-agent systems pay off for high-value tasks that split into many independent parts. They are a poor fit when the work has many dependencies between steps, such as many coding tasks.
- From Anthropic's "Building effective agents" guide: start with the simplest solution and add complexity only when it clearly improves results. Many jobs need only a single call, or a fixed workflow, and not an agent at all.
- The article gives effort rules of thumb: a simple fact-finding job needs 1 agent and about 3 to 10 tool calls; a direct comparison needs 2 to 4 subagents with about 10 to 15 calls each; complex research can use more than 10 subagents. Tell the lead agent how much effort a question deserves, or it may over-spend.
- Claude Opus 5 delegates to subagents more readily than earlier models, according to the Agent SDK docs. That makes depth, concurrency and spend limits (Lesson 6) more important.
- Question - If yes - If no

The exercise I'm working on:
Take a job from your own work or study (for example "prepare a weekly report from five sources"). Fill in the decision table, build the simplest version, and write the one-paragraph decision. Do not build the multi-agent version yet.

I'm stuck. Please:
1. Explain the main idea in plain, simple words with one everyday example.
2. Walk me through the exercise one small step at a time. Ask me what I've done so far before giving the next step.
3. Don't just give me the final answer. Help me do it myself, and check my work when I share it.
I'm a parent helping my child (about 8 years old) with a lesson called "One agent or many? Choose the simplest thing that works" from the course "Agent Systems: design, test and govern agents at scale".

Here's what the lesson says:
A small bakery needs one baker. A huge wedding order may need a head chef who hands out jobs: one person on cakes, one on bread, one on icing. But more cooks cost more money, and they need to talk to each other. So before hiring more cooks, ask: is one good cook enough?

The activity:
Take a job from your own work or study (for example "prepare a weekly report from five sources"). Fill in the decision table, build the simplest version, and write the one-paragraph decision. Do not build the multi-agent version yet.

Please explain this so an 8-year-old understands: short sentences, a fun everyday example, and no hard words.
Then give me 3 simple questions I can ask my child to check they understood, and a way to do the activity together, one tiny step at a time.
Open Claude
Sources
My notes
02

Design the team: a lead, subagents and clear briefs

This lesson is part of full access: every course and every level for one payment.

03

Evaluation suites: how you know the system works

This lesson is part of full access: every course and every level for one payment.

04

Permissions in layers: least agency

This lesson is part of full access: every course and every level for one payment.

05

Monitoring: see what the system is doing

This lesson is part of full access: every course and every level for one payment.

06

Cost controls and limits

This lesson is part of full access: every course and every level for one payment.

07

Safety and incident-response plan, and leading the review

This lesson is part of full access: every course and every level for one payment.

++

Final project

This lesson is part of full access: every course and every level for one payment.

??

Quiz

  1. When do Anthropic's articles say multi-agent systems pay off most?

  2. What four things should a good subagent brief contain?

  3. What does a subagent receive from its parent?

  4. How can you make a reviewer subagent unable to edit files?

  5. What is a grader in an evaluation?

  6. If an agent succeeds in 75 percent of trials, roughly what is pass^3?

  7. What is the difference between capability evals and regression evals?

  8. Why grade outcomes and not only the agent's words?

  9. What three causes of "Excessive Agency" does OWASP name?

  10. In the Agent SDK, can an allow rule override a deny rule?

  11. Which cost field includes subagent spend: usage or total_cost_usd?

  12. What should your code do when the API returns the spend-limit error, and what for an ordinary rate limit?

EX

Final exam

This lesson is part of full access: every course and every level for one payment.

CE

Certificate

This lesson is part of full access: every course and every level for one payment.