You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
**Coordinator pattern with parallel extraction**. Batch triggers parallel extraction from multiple sources (APIs, databases, S3), transforms and validates data, loads to data warehouse with monitoring.
70
+
71
+
<divalign="center">
72
+
73
+
```mermaid
74
+
graph TB
75
+
A[runETLPipeline] --> B[coordinateExtraction]
76
+
B --> C[batchTriggerAndWait]
77
+
78
+
C --> D[extractFromAPI]
79
+
C --> E[extractFromDatabase]
80
+
C --> F[extractFromS3]
81
+
82
+
D --> G[transformData]
83
+
E --> G
84
+
F --> G
85
+
86
+
G --> H[validateData]
87
+
H --> I[loadToWarehouse]
88
+
```
89
+
90
+
</div>
61
91
</Tab>
92
+
62
93
<Tabtitle="Web scraping">
63
-
<Steps>
64
-
<Steptitle="Navigate">Load target pages with headless browser</Step>
<Steptitle="Store">Save to database or file storage</Step>
68
-
</Steps>
94
+
**Coordinator pattern with browser automation**. Launches headless browsers in parallel to scrape multiple pages, extracts structured data, cleans and normalizes content, stores in database.
95
+
96
+
<divalign="center">
97
+
98
+
```mermaid
99
+
graph TB
100
+
A[scrapeSite] --> B[coordinateScraping]
101
+
B --> C[batchTriggerAndWait]
102
+
103
+
C --> D[scrapePage1]
104
+
C --> E[scrapePage2]
105
+
C --> F[scrapePageN]
106
+
107
+
D --> G[cleanData]
108
+
E --> G
109
+
F --> G
110
+
111
+
G --> H[normalizeData]
112
+
H --> I[storeInDatabase]
113
+
```
114
+
115
+
</div>
69
116
</Tab>
117
+
70
118
<Tabtitle="Batch enrichment">
71
-
<Steps>
72
-
<Steptitle="Query">Fetch records needing enrichment</Step>
73
-
<Steptitle="Enrich">Call external APIs in parallel batches</Step>
74
-
<Steptitle="Validate">Check data quality and completeness</Step>
75
-
<Steptitle="Update">Write enriched data back to database</Step>
76
-
</Steps>
77
-
</Tab>
78
-
<Tabtitle="File processing">
79
-
<Steps>
80
-
<Steptitle="Upload">Receive file via webhook or storage event</Step>
81
-
<Steptitle="Parse">Read CSV, JSON, XML, or binary format</Step>
82
-
<Steptitle="Process">Transform, validate, chunk large files</Step>
83
-
<Steptitle="Import">Bulk insert to database or data warehouse</Step>
84
-
</Steps>
119
+
**Coordinator pattern with rate limiting**. Fetches records needing enrichment, batch triggers parallel API calls with configurable concurrency to respect rate limits, validates enriched data, updates database.
<Steptitle="Deliver">Send via email, SMS, or in-app</Step>
73
-
</Steps>
71
+
72
+
<Tabtitle="Multi-channel">
73
+
**Router pattern with delay orchestration**. User action triggers campaign, router selects channel based on preferences (email/SMS/push), coordinates multi-day sequence with delays between messages, tracks engagement across channels.
74
+
75
+
<divalign="center">
76
+
77
+
```mermaid
78
+
graph TB
79
+
A[startCampaign] --> B[fetchUserProfile]
80
+
B --> C[selectChannel]
81
+
C --> D{Preferred<br/>Channel?}
82
+
83
+
D -->|Email| E[sendEmail1]
84
+
D -->|SMS| F[sendSMS1]
85
+
D -->|Push| G[sendPush1]
86
+
87
+
E --> H[wait.for 2d]
88
+
F --> H
89
+
G --> H
90
+
91
+
H --> I[sendFollowUp]
92
+
I --> J[trackConversion]
93
+
```
94
+
95
+
</div>
74
96
</Tab>
97
+
75
98
<Tabtitle="Content approval">
76
-
<Steps>
77
-
<Steptitle="Create draft">Generate AI content or asset</Step>
78
-
<Steptitle="Human review">Pause for approval workflow</Step>
79
-
<Steptitle="Revise">Apply feedback if needed</Step>
80
-
<Steptitle="Approve">Mark ready for publishing</Step>
81
-
<Steptitle="Publish">Deploy to channels</Step>
82
-
</Steps>
99
+
**Supervisor pattern with approval gate**. Generates AI marketing content (images, copy, assets), pauses with wait.for for human review, applies revisions if needed, publishes to channels after approval.
**Coordinator pattern with rate limiting**. Receives batch of generation requests, coordinates parallel processing with configurable concurrency to respect API rate limits, validates outputs, stores results.
70
+
71
+
<divalign="center">
72
+
73
+
```mermaid
74
+
graph TB
75
+
A[processBatch] --> B[coordinateGeneration]
76
+
B --> C[batchTriggerAndWait]
77
+
78
+
C --> D[generateImage1]
79
+
C --> E[generateImage2]
80
+
C --> F[generateImageN]
81
+
82
+
D --> G[validateResults]
83
+
E --> G
84
+
F --> G
85
+
86
+
G --> H[storeResults]
87
+
H --> I[notifyCompletion]
88
+
```
89
+
90
+
</div>
69
91
</Tab>
92
+
70
93
<Tabtitle="Multi-step pipeline">
71
-
<Steps>
72
-
<Steptitle="Generate">Create initial content with AI</Step>
73
-
<Steptitle="Transform">Apply style transfer or enhancement</Step>
<Steptitle="Optimize">Compress and format for delivery</Step>
76
-
</Steps>
94
+
**Coordinator pattern with sequential processing**. Generates initial content with AI, applies style transfer or enhancement, upscales resolution, optimizes and compresses for delivery.
95
+
96
+
<divalign="center">
97
+
98
+
```mermaid
99
+
graph TB
100
+
A[processCreative] --> B[generateWithAI]
101
+
B --> C[applyStyleTransfer]
102
+
C --> D[upscaleResolution]
103
+
D --> E[optimizeAndCompress]
104
+
E --> F[uploadToStorage]
105
+
```
106
+
107
+
</div>
77
108
</Tab>
109
+
78
110
<Tabtitle="Human-in-the-loop">
79
-
<Steps>
80
-
<Steptitle="Generate">Create AI content</Step>
81
-
<Steptitle="Review">Pause for human approval</Step>
82
-
<Steptitle="Revise">Apply feedback if needed</Step>
**Supervisor pattern with approval gate**. Generates AI content, pauses execution with wait.for to allow human review, applies feedback if needed, publishes approved content.
0 commit comments