Commits

Commit history

1. Commits on Jul 11, 2020

   • [SPARK-32245][INFRA] Run Spark tests in Github Actions

     Show description for b84ed41
     

     HyukjinKwon

     authored and

     dongjoon-hyun

     committed
     b84ed41View commit details

     Copy full SHA for b84ed41

     View code at this pointBrowse repository at this point

   • [SPARK-32232][ML][PYSPARK] Make sure ML has the same default solver values between Scala and Python

     Show description for 99b4b06
     

     huaxingao

     authored and

     srowen

     committed
     99b4b06View commit details

     Copy full SHA for 99b4b06

     View code at this pointBrowse repository at this point
2. Commits on Jul 10, 2020

   • [SPARK-20680][SQL][FOLLOW-UP] Revert NullType.simpleString from 'unknown' to 'null'

     Show description for 01e9dd9
     

     HyukjinKwon

     authored and

     dongjoon-hyun

     committed
     01e9dd9View commit details

     Copy full SHA for 01e9dd9

     View code at this pointBrowse repository at this point
3. Commits on Jul 9, 2020

   • [SPARK-32160][CORE][PYSPARK] Disallow to create SparkContext in executors

     Show description for cfecc20
     

     ueshin

     authored and

     HyukjinKwon

     committed
     cfecc20View commit details

     Copy full SHA for cfecc20

     View code at this pointBrowse repository at this point
4. Commits on Jul 8, 2020

   • [SPARK-20680][SQL] Spark-sql do not support for creating table with void column datatype

     Show description for b5297c4
     

     LantaoJin

     authored and

     dongjoon-hyun

     committed
     b5297c4View commit details

     Copy full SHA for b5297c4

     View code at this pointBrowse repository at this point
5. Commits on Jul 6, 2020

   • [SPARK-32162][PYTHON][TESTS] Improve error message of Pandas grouped map test with window

     Show description for 1d18096
     

     BryanCutler

     authored and

     HyukjinKwon

     committed
     1d18096View commit details

     Copy full SHA for 1d18096

     View code at this pointBrowse repository at this point
6. Commits on Jul 2, 2020

   • [MINOR][DOCS] Pyspark getActiveSession docstring

     Show description for 45fe6b6
     

     animenon

     authored and

     HyukjinKwon

     committed
     45fe6b6View commit details

     Copy full SHA for 45fe6b6

     View code at this pointBrowse repository at this point
7. Commits on Jul 1, 2020

   • [SPARK-23631][ML][PYSPARK] Add summary to RandomForestClassificationModel

     Show description for f7d9e3d
     

     huaxingao

     authored and

     srowen

     committed
     f7d9e3dView commit details

     Copy full SHA for f7d9e3d

     View code at this pointBrowse repository at this point

   • [SPARK-32088][PYTHON][FOLLOWUP] Replace `collect()` by `show()` in the example for `timestamp_seconds`

     Show description for dd03c31
     

     MaxGekk

     authored and

     HyukjinKwon

     committed
     dd03c31View commit details

     Copy full SHA for dd03c31

     View code at this pointBrowse repository at this point
8. Commits on Jun 27, 2020

   • [SPARK-32088][PYTHON] Pin the timezone in timestamp_seconds doctest

     Show description for ac3a055
     

     GuoPhilipse

     authored and

     dongjoon-hyun

     committed
     ac3a055View commit details

     Copy full SHA for ac3a055

     View code at this pointBrowse repository at this point
9. Commits on Jun 26, 2020

   • [SPARK-20249][ML][PYSPARK] Add training summary for LinearSVCModel

     Show description for 8795133
     

     huaxingao

     authored and

     srowen

     committed
     8795133View commit details

     Copy full SHA for 8795133

     View code at this pointBrowse repository at this point

   • [SPARK-19939][ML] Add support for association rules in ML

     Show description for d125529
     

     huaxingao

     authored and

     srowen

     committed
     d125529View commit details

     Copy full SHA for d125529

     View code at this pointBrowse repository at this point
10. Commits on Jun 25, 2020

    • [SPARK-32098][PYTHON] Use iloc for positional slicing instead of direct slicing in createDataFrame with Arrow

      Show description for 1af19a7
      

      HyukjinKwon

      authored and

      BryanCutler

      committed
      1af19a7View commit details

      Copy full SHA for 1af19a7

      View code at this pointBrowse repository at this point
11. Commits on Jun 20, 2020

    • [SPARK-31893][ML] Add a generic ClassificationSummary trait

      Show description for 297016e
      

      huaxingao

      authored and

      srowen

      committed
      297016eView commit details

      Copy full SHA for 297016e

      View code at this pointBrowse repository at this point
12. Commits on Jun 17, 2020

    • [SPARK-32011][PYTHON][CORE] Remove warnings about pin-thread modes and guide to use collectWithJobGroup

      Show description for feeca63
      HyukjinKwon

      committed
      feeca63View commit details

      Copy full SHA for feeca63

      View code at this pointBrowse repository at this point
13. Commits on Jun 16, 2020

    • [SPARK-31777][ML][PYSPARK] Add user-specified fold column to CrossValidator

      Show description for 7f6a8ab
      viirya

      committed
      7f6a8abView commit details

      Copy full SHA for 7f6a8ab

      View code at this pointBrowse repository at this point

    • [SPARK-31710][SQL] Fail casting numeric to timestamp by default

      Show description for f0e6d0e
      

      GuoPhilipse

      authored and

      cloud-fan

      committed
      f0e6d0eView commit details

      Copy full SHA for f0e6d0e

      View code at this pointBrowse repository at this point
14. Commits on Jun 15, 2020

    • [SPARK-31925][ML] Summary.totalIterations greater than maxIters

      Show description for f83cb3c
      

      huaxingao

      authored and

      srowen

      committed
      f83cb3cView commit details

      Copy full SHA for f83cb3c

      View code at this pointBrowse repository at this point
15. Commits on Jun 11, 2020

    • [SPARK-31966][ML][TESTS][PYTHON] Increase the timeout for StreamingLogisticRegressionWithSGDTests.test_training_and_prediction

      Show description for 56d4f27
      

      HyukjinKwon

      authored and

      dongjoon-hyun

      committed
      56d4f27View commit details

      Copy full SHA for 56d4f27

      View code at this pointBrowse repository at this point

    • [SPARK-31965][TESTS][PYTHON] Move doctests related to Java function registration to test conditionally

      Show description for 56264fb
      

      HyukjinKwon

      authored and

      dongjoon-hyun

      committed
      56264fbView commit details

      Copy full SHA for 56264fb

      View code at this pointBrowse repository at this point

    • [SPARK-31964][PYTHON] Use Pandas is_categorical on Arrow category type conversion

      Show description for b7ef529
      

      BryanCutler

      authored and

      HyukjinKwon

      committed
      b7ef529View commit details

      Copy full SHA for b7ef529

      View code at this pointBrowse repository at this point
16. Commits on Jun 10, 2020

    • [SPARK-31915][SQL][PYTHON] Resolve the grouping column properly per the case sensitivity in grouped and cogrouped pandas UDFs

      Show description for 00d06ca
      

      HyukjinKwon

      authored and

      BryanCutler

      committed
      00d06caView commit details

      Copy full SHA for 00d06ca

      View code at this pointBrowse repository at this point

    • [SPARK-31963][PYSPARK][SQL] Support both pandas 0.23 and 1.0 in serializers.py

      Show description for 2ab82fa
      

      williamhyun

      authored and

      dongjoon-hyun

      committed
      2ab82faView commit details

      Copy full SHA for 2ab82fa

      View code at this pointBrowse repository at this point

    • [SPARK-31945][SQL][PYSPARK] Enable cache for the same Python function

      Show description for 032d179
      

      ueshin

      authored and

      HyukjinKwon

      committed
      032d179View commit details

      Copy full SHA for 032d179

      View code at this pointBrowse repository at this point
17. Commits on Jun 9, 2020

    • [SPARK-31849][PYTHON][SQL][FOLLOW-UP] More correct error message in Python UDF exception message

      Show description for e289140
      HyukjinKwon

      committed
      e289140View commit details

      Copy full SHA for e289140

      View code at this pointBrowse repository at this point
18. Commits on Jun 8, 2020

    • [SPARK-31849][PYTHON][SQL][FOLLOW-UP] Deduplicate and reuse Utils.exceptionString in Python exception handling

      Show description for a42af81
      HyukjinKwon

      committed
      a42af81View commit details

      Copy full SHA for a42af81

      View code at this pointBrowse repository at this point
19. Commits on Jun 5, 2020

    • [MINOR][PYTHON] Add one more newline between JVM and Python tracebacks

      Show description for 53ce58d
      HyukjinKwon

      committed
      53ce58dView commit details

      Copy full SHA for 53ce58d

      View code at this pointBrowse repository at this point
20. Commits on Jun 3, 2020

    • [SPARK-31895][PYTHON][SQL] Support DataFrame.explain(extended: str) case to be consistent with Scala side

      Show description for e1d5201
      HyukjinKwon

      committed
      e1d5201View commit details

      Copy full SHA for e1d5201

      View code at this pointBrowse repository at this point
21. Commits on Jun 2, 2020

    • [SPARK-29137][ML][PYTHON][TESTS] Increase the timeout for StreamingLinearRegressionWithTests.test_train_prediction

      Show description for 64cb6f7
      

      HyukjinKwon

      authored and

      dongjoon-hyun

      committed
      64cb6f7View commit details

      Copy full SHA for 64cb6f7

      View code at this pointBrowse repository at this point
22. Commits on Jun 1, 2020

    • [SPARK-31849][PYTHON][SQL] Make PySpark SQL exceptions more Pythonic

      Show description for e694660
      HyukjinKwon

      committed
      e694660View commit details

      Copy full SHA for e694660

      View code at this pointBrowse repository at this point

    • [SPARK-31788][CORE][DSTREAM][PYTHON] Recover the support of union for different types of RDD and DStreams

      Show description for 29c51d6
      HyukjinKwon

      committed
      29c51d6View commit details

      Copy full SHA for 29c51d6

      View code at this pointBrowse repository at this point
23. Commits on May 31, 2020

    • [SPARK-31840][ML] Add instance weight support in LogisticRegressionSummary

      Show description for 45cf5e9
      

      huaxingao

      authored and

      srowen

      committed
      45cf5e9View commit details

      Copy full SHA for 45cf5e9

      View code at this pointBrowse repository at this point
24. Commits on May 28, 2020

    • [SPARK-25351][PYTHON][TEST][FOLLOWUP] Fix test assertions to be consistent

      Show description for 8bbb666
      

      BryanCutler

      authored and

      HyukjinKwon

      committed
      8bbb666View commit details

      Copy full SHA for 8bbb666

      View code at this pointBrowse repository at this point

    • [SPARK-31763][PYSPARK] Add `inputFiles` method in PySpark DataFrame Class

      Show description for 2f92ea0
      

      iRakson

      authored and

      HyukjinKwon

      committed
      2f92ea0View commit details

      Copy full SHA for 2f92ea0

      View code at this pointBrowse repository at this point

    • [SPARK-25351][SQL][PYTHON] Handle Pandas category type when converting from Python with Arrow

      Show description for 339b0ec
      

      Jalpan Randeri

      authored and

      BryanCutler

      committed
      339b0ecView commit details

      Copy full SHA for 339b0ec

      View code at this pointBrowse repository at this point