Read Parquet unsigned int64 logical type that stored as signed int64 physical type to decimal(20, 0) ( SPARK-34786).Read parquet unsigned types that are stored as int32 physical type in parquet ( SPARK-34817). Add new parquet data source options to control datetime rebasing in read ( SPARK-34377).Support column index in Parquet vectorized reader ( SPARK-34289).Upgrade Apache Parquet used to version 1.12.1 ( SPARK-36726).Improve performance of processing FETCH_PRIOR in Spark Thrift server ( SPARK-33655).Allow concurrent writers for writing dynamic partitions and bucket table ( SPARK-26164).Broadcast nested loop join improvement ( SPARK-34706).Whole plan exchange and subquery reuse ( SPARK-29375).Add code-gen for all join types of sort-merge join ( SPARK-34705).Enable Zstandard buffer pool by default ( SPARK-34340, SPARK-34390).Allow custom plugin for AQE cost evaluator ( SPARK-35794).Support AQE side broadcast hash join threshold ( SPARK-35264).
0 Comments
Leave a Reply. |