Prompt Batch Architecture

Glossary Term

The umbrella term for how
Prompt
s process multiple items in a single run. Three patterns exist, each suited to different batch needs:
  1. Execution Mode ( prompts) — required for all
    Setup Prompt
    s; controls whether the prompt uses an iterator or procedural pipeline.
  1. Loop Processing ( prompts) — opt-in for
    Author Prompt
    s; enables item-by-item iteration with shared-phase optimization.
  1. Per-Prompt Batch Logic — custom batch architecture for prompts with inter-item dependencies requiring cross-item resolution or dependency ordering.
Every prompt that processes more than one item must use exactly one of these patterns. Documented in the Prompt Batch Architecture section of the page.