Labs โ€บ durable multi-agent workflow0 / 14

Step 1 of 14 ยท Intro

Design a durable multi-agent workflow

A planner, parallel researchers, a writer and a reviewer, built so a crash, a database failover or a model outage cannot lose or repeat work.

How it works

  • โ€บEvery change in a run is written to a durable event log first. State in the database is a fast copy that can be rebuilt from it.
  • โ€บDelivery is at least once, so every step and every tool call carries an idempotency key and a repeat is harmless.
  • โ€บWorkers are replaceable. A coordinator resumes unfinished runs from the last checkpoint; retries use backoff and bad events go to a dead-letter store.
  • โ€บOne run fans out into many calls (about 20 model calls, 12 tool calls and 40 state writes). The simulator models this as step events per second, not per run.

What you'll build

  1. The run API and its data model
  2. An event log, workers and a state database
  3. Agent, tool and state consumer groups with model capacity
  4. A peak design inside a monthly budget
  5. Survival of a worker crash, a state-store failover and a model-provider outage