Skip to content

[v3-3-test] Add Task SDK, Go and Java SDK execution architecture diagrams (#69750)#70100

Merged
potiuk merged 1 commit into
v3-3-testfrom
backport-2de0223-v3-3-test
Jul 19, 2026
Merged

[v3-3-test] Add Task SDK, Go and Java SDK execution architecture diagrams (#69750)#70100
potiuk merged 1 commit into
v3-3-testfrom
backport-2de0223-v3-3-test

Conversation

@github-actions

Copy link
Copy Markdown
Contributor
  • Add Task SDK, Go and Java SDK execution architecture diagrams

Add graphviz-generated diagrams to the architecture overview showing how a
task actually runs across the different SDKs, and embed them in
core-concepts/overview.rst:

  • Python Task SDK: supervised (two native OS processes over a msgpack socket)
    vs native/in-process paths, plus a numbered message-flow sequence.
  • Go SDK: standalone edge worker pulling from the Edge API, task talks to the
    Execution API directly.
  • Java (JVM) SDK: Coordinator layer reusing the Python Supervisor, driving a
    JVM subprocess over loopback TCP, with an architecture diagram and a numbered
    execution-workflow sequence.
  • Draw Task and Java SDK execution flows as true sequence diagrams

The message-flow diagrams added earlier in this PR drew every step on a single
vertical spine, so the request/response round-trips between the task runtime and
the Supervisor were hard to follow. Responding to review feedback, redraw them
as true sequence diagrams — one lifeline per participant with the Supervisor in
the middle — so each round-trip reads as arrows going back and forth between
neighboring lifelines, with straight message arrows and margined labels.
(cherry picked from commit 2de0223)

Co-authored-by: Jarek Potiuk jarek@potiuk.com

…rams (#69750)

* Add Task SDK, Go and Java SDK execution architecture diagrams

Add graphviz-generated diagrams to the architecture overview showing how a
task actually runs across the different SDKs, and embed them in
core-concepts/overview.rst:

- Python Task SDK: supervised (two native OS processes over a msgpack socket)
  vs native/in-process paths, plus a numbered message-flow sequence.
- Go SDK: standalone edge worker pulling from the Edge API, task talks to the
  Execution API directly.
- Java (JVM) SDK: Coordinator layer reusing the Python Supervisor, driving a
  JVM subprocess over loopback TCP, with an architecture diagram and a numbered
  execution-workflow sequence.

* Draw Task and Java SDK execution flows as true sequence diagrams

The message-flow diagrams added earlier in this PR drew every step on a single
vertical spine, so the request/response round-trips between the task runtime and
the Supervisor were hard to follow. Responding to review feedback, redraw them
as true sequence diagrams — one lifeline per participant with the Supervisor in
the middle — so each round-trip reads as arrows going back and forth between
neighboring lifelines, with straight message arrows and margined labels.
(cherry picked from commit 2de0223)

Co-authored-by: Jarek Potiuk <jarek@potiuk.com>
@potiuk
potiuk marked this pull request as ready for review July 19, 2026 16:49
@potiuk
potiuk merged commit 6d8c750 into v3-3-test Jul 19, 2026
67 checks passed
@potiuk
potiuk deleted the backport-2de0223-v3-3-test branch July 19, 2026 20:30
@github-actions github-actions Bot added this to the Airflow 3.3.1 milestone Jul 19, 2026
@github-actions

Copy link
Copy Markdown
Contributor Author

Hi maintainer, this PR was merged without a milestone set.
We've automatically set the milestone to Airflow 3.3.1 based on: merged to version branch
If this milestone is not correct, please update it to the appropriate milestone.

This comment was generated by Milestone Tag Assistant.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant