Commit c5983c1
[SPARK-38018][SQL][3.2] Fix ColumnVectorUtils.populate to handle CalendarIntervalType correctly
### What changes were proposed in this pull request?
This is a backport of #35314 to branch 3.2. See that original PR for context.
### Why are the changes needed?
To fix potential correctness issue.
### Does this PR introduce _any_ user-facing change?
No but fix the exiting correctness issue when reading partition column with CalendarInterval type.
### How was this patch tested?
Added unit test in `ColumnVectorSuite.scala`.
Closes #37114 from c21/branch-3.2.
Authored-by: Cheng Su <[email protected]>
Signed-off-by: Wenchen Fan <[email protected]>1 parent 32aff86 commit c5983c1
File tree
2 files changed
+12
-2
lines changed- sql/core/src
- main/java/org/apache/spark/sql/execution/vectorized
- test/scala/org/apache/spark/sql/execution/vectorized
2 files changed
+12
-2
lines changedLines changed: 2 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
91 | 91 | | |
92 | 92 | | |
93 | 93 | | |
94 | | - | |
| 94 | + | |
| 95 | + | |
95 | 96 | | |
96 | 97 | | |
97 | 98 | | |
| |||
Lines changed: 10 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
25 | 25 | | |
26 | 26 | | |
27 | 27 | | |
28 | | - | |
| 28 | + | |
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
| |||
536 | 536 | | |
537 | 537 | | |
538 | 538 | | |
| 539 | + | |
| 540 | + | |
| 541 | + | |
| 542 | + | |
| 543 | + | |
| 544 | + | |
| 545 | + | |
| 546 | + | |
| 547 | + | |
539 | 548 | | |
540 | 549 | | |
0 commit comments