Skip to content

Proto: add DataSource/FileSource try_to_proto hook + port FileScanConfig serde #23497

Description

@adriangb

Part of #23494.

Add a try_to_proto hook to the DataSource and FileSource traits in datafusion-datasource (default Ok(None), feature proto), so DataSourceExec rides the ExecutionPlan hook and delegates DataSource → FileSource with no downcast. Port the shared FileScanConfig ⇄ proto conversion out of datafusion-proto into datafusion-datasource (orderings/exprs via the ctx; schema/stats/scalars via datafusion-proto-common). No PhysicalExtensionCodec needed.

Blocks the file-scan and memory-source sub-issues.

See #23494 for the overall pattern and the ctx API. The reference implementation of this hook chain (and the FileScanConfig/FileSinkConfig serde port) is in the full draft #23496. No wire-format change; delete the old central dispatch in the same PR.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions