Skip to content

[Docs] Library User Guide page for adding your own custom SQL syntax #19087

@alamb

Description

@alamb

Is your feature request related to a problem or challenge?

in #17843, @geoffreyclaude added the RelationPlanner that, along with the existing ExprPlanner and TypePlanners allows Datafusion users to extend SQL in many powerful ways

#17843 has several great examples, but they may not be all that discoverable (easy for others to find)

Describe the solution you'd like

I think it would be even better to add a page to the documentation with a high level overview:

Describe alternatives you've considered

Add a page to the user guide https://datafusion.apache.org/library-user-guide with high level guidance of how to extend SQL

  1. Explain the usecase for extending SQL syntax (that different systems have different SQL needs and instead of forcing one SQL dialect, DataFusion allows you to extend your own)
  2. Enumerate the extension points and give examples
  • ExprPlanner: Allows one to intercept arbitrary expressions / operators (e.g. can plan the : operator for variant)
  • TypePlanner: Allow supporting arbitrary types
  • RelationPlanner (added in #17843) : Allow planning items in the FROM clause, such as PIVOT/UNPIVOT, TABLESAMPLE, etc

Additional context

I also suggest a blog for this content as well

I think there would be substantial overlap with the content of the user guide page (which is fine

Metadata

Metadata

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions