Skip to content

[FLINK] Support compression in hive table sink #12572

Description

@KevinyhZou

Description

currently, we have support parquet, text, orc format in filesystem writer, and when hive table defines a compression algothirm, gluten should offload the algothirm to velox, and velox write compressed files with different algothirms, such as snappy, zstd.

Gluten version

None

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions