Skip to content

WIP duckdb build with kafka extension#22

Open
solsson wants to merge 2 commits into
mainfrom
duckdb-build
Open

WIP duckdb build with kafka extension#22
solsson wants to merge 2 commits into
mainfrom
duckdb-build

Conversation

@solsson
Copy link
Copy Markdown
Contributor

@solsson solsson commented May 21, 2026

Evaluated https://duckdb.org/community_extensions/extensions/tributary but two issues:

  • consumption from offset is still "Roadmap"
  • GHA build timed out after 45 min, probably too heavy for us

solsson and others added 2 commits May 21, 2026 11:50
Build duckdb from source (manylinux + vcpkg toolchain, mirroring duckdb's
community-extension CI) so the tributary Kafka extension — which has no
prebuilt binary for any 1.5.x — can be statically linked, alongside httpfs
(https:// and gcs gs:// access). Extensions are baked in (loaded, no runtime
download/signing). BuildKit cache mounts cover ccache and vcpkg deps.

Also bumps @duckdb/node-bindings to 1.5.3-r.1.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Statically link the nanoarrow extension (Apache Arrow IPC; "arrow" is an
alias) alongside tributary and httpfs.

Stop hardcoding the httpfs version: include duckdb's own
.github/config/extensions/httpfs.cmake from the checked-out DUCKDB_TAG so it
always matches the duckdb release.

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant