Skip to content

add iceberg support#183

Open
zhangjun0x01 wants to merge 4 commits intoalibaba:masterfrom
zhangjun0x01:iceberg
Open

add iceberg support#183
zhangjun0x01 wants to merge 4 commits intoalibaba:masterfrom
zhangjun0x01:iceberg

Conversation

@zhangjun0x01
Copy link
Copy Markdown

Iceberg is a popular data lake framework. I think we should add iceberg as the data source of alink.

At present, I add alink to read iceberg without add write operations, because their APIs are incompatible. Flick realizes the integration of batch and stream. Iceberg also uses Datastream to realize batch and stream processing. However, at present, alink uses Dataset for batch processing, so I don't find a good way to be compatible at the moment.

@CLAassistant
Copy link
Copy Markdown

CLAassistant commented Oct 22, 2021

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants