Skip to content

feat(scheduler): adopt DataFusion's cost-based join order enumeration #2352

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
Dandandan wants to merge 3 commits into
base: main
Choose a base branch
from
Draft

feat(scheduler): adopt DataFusion's cost-based join order enumeration #2352

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
2feae58
chore(deps): advance DataFusion to main and pin apache/datafusion#24456
Dandandan Aug 20, 2026
deb2332
fix(scheduler): run join enumeration once, not on every AQE replan
Dandandan Aug 20, 2026
fcefb33
test: update AQE snapshots for join enumeration
Dandandan Aug 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
82 changes: 42 additions & 40 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

22 changes: 13 additions & 9 deletions Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -135,13 +135,17 @@ debug = false
debug-assertions = false
incremental = false

# Redirect the crates.io datafusion release to the pinned git tag. Bump the
# tag here to advance DataFusion; the workspace-dep versions above stay put.
# Redirect the crates.io datafusion release to a pinned git rev. Bump the rev
# here to advance DataFusion; the workspace-dep versions above stay put.
#
# Currently apache/datafusion#24456 (cost-based join order enumeration), which
# is not merged yet. Repoint at an apache/datafusion rev once it is; its merge
# base with main is f1f0449a5327a03cc99817fcd0ac8531f0c015ec.
[patch.crates-io]
datafusion = { git = "https://github.com/apache/datafusion.git", tag = "55.0.0-rc3" }
datafusion-cli = { git = "https://github.com/apache/datafusion.git", tag = "55.0.0-rc3" }
datafusion-functions-aggregate-common = { git = "https://github.com/apache/datafusion.git", tag = "55.0.0-rc3" }
datafusion-proto = { git = "https://github.com/apache/datafusion.git", tag = "55.0.0-rc3" }
datafusion-proto-common = { git = "https://github.com/apache/datafusion.git", tag = "55.0.0-rc3" }
datafusion-spark = { git = "https://github.com/apache/datafusion.git", tag = "55.0.0-rc3" }
datafusion-substrait = { git = "https://github.com/apache/datafusion.git", tag = "55.0.0-rc3" }
datafusion = { git = "https://github.com/Dandandan/arrow-datafusion.git", rev = "29c224d86b" }
datafusion-cli = { git = "https://github.com/Dandandan/arrow-datafusion.git", rev = "29c224d86b" }
datafusion-functions-aggregate-common = { git = "https://github.com/Dandandan/arrow-datafusion.git", rev = "29c224d86b" }
datafusion-proto = { git = "https://github.com/Dandandan/arrow-datafusion.git", rev = "29c224d86b" }
datafusion-proto-common = { git = "https://github.com/Dandandan/arrow-datafusion.git", rev = "29c224d86b" }
datafusion-spark = { git = "https://github.com/Dandandan/arrow-datafusion.git", rev = "29c224d86b" }
datafusion-substrait = { git = "https://github.com/Dandandan/arrow-datafusion.git", rev = "29c224d86b" }
Loading
Loading