Sub-task
- [SPARK-22603] - 64KB JVM bytecode limit problem with FormatString
Bug
- [SPARK-21278] - Upgrade to Py4J 0.10.6
- [SPARK-22162] - Executors and the driver use inconsistent Job IDs during the new RDD commit protocol
- [SPARK-22289] - Cannot save LogisticRegressionModel with bounds on coefficients
- [SPARK-22373] - Intermittent NullPointerException in org.codehaus.janino.IClass.isAssignableFrom
- [SPARK-22574] - Wrong request causing Spark Dispatcher going inactive
- [SPARK-22607] - Set large stack size consistently for tests to avoid StackOverflowError
- [SPARK-22635] - FileNotFoundException again while reading ORC files containing special characters
- [SPARK-22637] - CatalogImpl.refresh() has quadratic complexity for a view
- [SPARK-22653] - executorAddress registered in CoarseGrainedSchedulerBackend.executorDataMap is null
- [SPARK-22654] - Retry download of Spark from ASF mirror in HiveExternalCatalogVersionsSuite
- [SPARK-22686] - DROP TABLE IF EXISTS should not show AnalysisException
- [SPARK-22700] - Bucketizer.transform incorrectly drops row containing NaN
- [SPARK-22817] - Use fixed testthat version for SparkR tests in AppVeyor
- [SPARK-22862] - Docs on lazy elimination of columns missing from an encoder.
- [SPARK-22889] - CRAN checks can fail if older Spark install exists
- [SPARK-22972] - Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc.
- [SPARK-22975] - MetricsReporter producing NullPointerException when there was no progress reported
- [SPARK-22982] - Remove unsafe asynchronous close() call from FileDownloadChannel
- [SPARK-22983] - Don't push filters beneath aggregates with empty grouping expressions
- [SPARK-22984] - Fix incorrect bitmap copying and offset shifting in GenerateUnsafeRowJoiner
- [SPARK-23001] - NullPointerException when running desc database
- [SPARK-23038] - Update docker/spark-test (JDK/OS)
- [SPARK-23053] - taskBinarySerialization and task partitions calculate in DagScheduler.submitMissingTasks should keep the same RDD checkpoint status
- [SPARK-23186] - Initialize DriverManager first before loading Drivers
- [SPARK-23230] - When hive.default.fileformat is other kinds of file types, create textfile table cause a serde error
- [SPARK-23281] - Query produces results in incorrect order when a composite order by clause refers to both original columns and aliases
- [SPARK-23358] - When the number of partitions is greater than 2^28, it will result in an error result
- [SPARK-23376] - creating UnsafeKVExternalSorter with BytesToBytesMap may fail
- [SPARK-23391] - It may lead to overflow for some integer multiplication
- [SPARK-23433] - java.lang.IllegalStateException: more than one active taskSet for stage
- [SPARK-23434] - Spark should not warn `metadata directory` for a HDFS file path
- [SPARK-23438] - DStreams could lose blocks with WAL enabled when driver crashes
- [SPARK-23489] - Flaky Test: HiveExternalCatalogVersionsSuite
- [SPARK-23508] - blockManagerIdCache in BlockManagerId may cause oom
- [SPARK-23525] - ALTER TABLE CHANGE COLUMN COMMENT doesn't work for external hive table
- [SPARK-23649] - CSV schema inferring fails on some UTF-8 chars
- [SPARK-23697] - Accumulators of Spark 1.x no longer work with Spark 2.x
- [SPARK-23732] - Broken link to scala source code in Spark Scala api Scaladoc
- [SPARK-23759] - Unable to bind Spark UI to specific host name / IP
- [SPARK-23788] - Race condition in StreamingQuerySuite
- [SPARK-23816] - FetchFailedException when killing speculative task
- [SPARK-23850] - We should not redact username|user|url from UI by default
- [SPARK-23941] - Mesos task failed on specific spark app name
- [SPARK-24007] - EqualNullSafe for FloatType and DoubleType might generate a wrong result by codegen.
- [SPARK-24257] - LongToUnsafeRowMap calculate the new size may be wrong
- [SPARK-24506] - Spark.ui.filters not applied to /sqlserver/ url
- [SPARK-24531] - HiveExternalCatalogVersionsSuite failing due to missing 2.2.0 version
- [SPARK-24552] - Task attempt numbers are reused when stages are retried
- [SPARK-24589] - OutputCommitCoordinator may allow duplicate commits
- [SPARK-26612] - Speculation kill causing finished stage recomputed
- [SPARK-26614] - Speculation kill might cause job failure
Improvement
- [SPARK-22601] - Data load is getting displayed successful on providing non existing hdfs file path
- [SPARK-22688] - Upgrade Janino version to 3.0.8
- [SPARK-22897] - Expose stageAttemptId in TaskContext
- [SPARK-23963] - Queries on text-based Hive tables grow disproportionately slower as the number of columns increase
Edit/Copy Release Notes
The text area below allows the project release notes to be edited and copied to another document.