Skip to main content

Combining Workers

Combining workers well leads to cleaner, more maintainable workflows.

Linear Chains​

Simplest form: Output of each worker feeds the next. Good for straightforward ETL (Extract → Transform → Load(display)).

Branching (via Conditions)​

Use a Condition worker to decide if subsequent workers execute. Place non-essential or expensive tasks behind conditions.

Parallelism (Conceptual)​

If the platform offers parallel branches, treat each branch as an independent chain merging later. Where parallel UI is not explicit, simulate by sequencing and using selective conditions.

Reuse Patterns​

  • Split early: separate raw fetch from heavy transformations so you can reuse the raw stage in different branches.
  • Aggregate late: combine or summarize only when all necessary inputs are prepared.

Avoiding Pitfalls​

  • Over-long chains: split into sub-workflows (future feature) or comment clearly.
  • Circular dependency attempts: ensure each worker depends only on earlier outputs.

Next: Using AI to Generate Worker Code.