Skip to content

[Iceberg] Populate planning statistics from table metadata #608

Description

@gabotechs

Part of #599.

Populate planning-time statistics for IcebergDataSource from the Iceberg table and selected snapshot.

Essentially, implementing this TODO comment in the code:

// TODO: Implement planning time statistics for this DataSource.
// At this point, we have information about the iceberg::table::Table which we are about
// to read, so maybe there's something we can get from there.
Ok(Arc::new(Statistics::new_unknown(&self.schema)))

The snapshot summary and file metadata may provide row-count and byte-size estimates without planning all scan tasks.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions