Commit 65a476e
[SPARK-47221][SQL] Uses signatures from CsvParser to AbstractParser
### What changes were proposed in this pull request?
This PR proposes to change signature `CsvParser` to `AbstractParser` (its parent class).
### Why are the changes needed?
- It's better to use higher classes if they fit for better extendibility and maintenance.
- Univocity parser became inactive for the last three years, and we're missing bug fixes such as uniVocity/univocity-parsers#533. We should probably leverage their interface, and implement it in Spark for bug fixes and further performance improvement. This is a basework.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Existing test cases should cover.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closes apache#45328 from HyukjinKwon/SPARK-47221.
Authored-by: Hyukjin Kwon <[email protected]>
Signed-off-by: Max Gekk <[email protected]>1 parent 5672ec0 commit 65a476e
File tree
1 file changed
+5
-3
lines changed- sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv
1 file changed
+5
-3
lines changedLines changed: 5 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
20 | | - | |
| 20 | + | |
| 21 | + | |
21 | 22 | | |
22 | 23 | | |
23 | 24 | | |
| |||
110 | 111 | | |
111 | 112 | | |
112 | 113 | | |
113 | | - | |
| 114 | + | |
114 | 115 | | |
115 | 116 | | |
116 | 117 | | |
| |||
119 | 120 | | |
120 | 121 | | |
121 | 122 | | |
122 | | - | |
| 123 | + | |
| 124 | + | |
123 | 125 | | |
124 | 126 | | |
125 | 127 | | |
| |||
0 commit comments