Commits

Commit history

1. Commits on Sep 21, 2016

   • [SPARK-17583][SQL] Remove uesless rowSeparator variable and set auto-expanding buffer as default for maxCharsPerColumn option in CSV

     Show description for 25a020b
     

     HyukjinKwon

     authored and

     srowen

     committed
     25a020bView commit details

     Copy full SHA for 25a020b

     View code at this pointBrowse repository at this point

   • [SPARK-17219][ML] Add NaN value handling in Bucketizer

     Show description for 57dc326
     

     VinceShieh

     authored and

     srowen

     committed
     57dc326View commit details

     Copy full SHA for 57dc326

     View code at this pointBrowse repository at this point

   • [SPARK-17017][MLLIB][ML] add a chiSquare Selector based on False Positive Rate (FPR) test

     Show description for b366f18
     

     Peng, Meng

     authored and

     srowen

     committed
     b366f18View commit details

     Copy full SHA for b366f18

     View code at this pointBrowse repository at this point

   • [SPARK-17585][PYSPARK][CORE] PySpark SparkContext.addFile supports adding files recursively

     Show description for d3b8869
     yanboliang

     committed
     d3b8869View commit details

     Copy full SHA for d3b8869

     View code at this pointBrowse repository at this point
2. Commits on Sep 20, 2016

   • [SPARK-17437] Add uiWebUrl to JavaSparkContext and pyspark.SparkContext

     Show description for 4a426ff
     

     apetresc

     authored and

     srowen

     committed
     4a426ffView commit details

     Copy full SHA for 4a426ff

     View code at this pointBrowse repository at this point
3. Commits on Sep 19, 2016

   • [SPARK-17100] [SQL] fix Python udf in filter on top of outer join

     Show description for d810415
     

     Davies Liu

     authored and

     davies

     committed
     d810415View commit details

     Copy full SHA for d810415

     View code at this pointBrowse repository at this point
4. Commits on Sep 18, 2016

   • [SPARK-16462][SPARK-16460][SPARK-15144][SQL] Make CSV cast null values properly

     Show description for 1dbb725
     

     lw-lin

     authored and

     srowen

     committed
     1dbb725View commit details

     Copy full SHA for 1dbb725

     View code at this pointBrowse repository at this point
5. Commits on Sep 17, 2016

   • [SPARK-17548][MLLIB] Word2VecModel.findSynonyms no longer spuriously rejects the best match when invoked with a vector

     Show description for 25cbbe6
     

     willb

     authored and

     srowen

     committed
     25cbbe6View commit details

     Copy full SHA for 25cbbe6

     View code at this pointBrowse repository at this point
6. Commits on Sep 14, 2016

   • [SPARK-17472] [PYSPARK] Better error message for serialization failures of large objects in Python

     Show description for dbfc7aa
     

     ericl

     authored and

     davies

     committed
     dbfc7aaView commit details

     Copy full SHA for dbfc7aa

     View code at this pointBrowse repository at this point

   • [SPARK-17514] df.take(1) and df.limit(1).collect() should perform the same in Python

     Show description for 6d06ff6
     

     JoshRosen

     authored and

     davies

     committed
     6d06ff6View commit details

     Copy full SHA for 6d06ff6

     View code at this pointBrowse repository at this point

   • [SPARK-17525][PYTHON] Remove SparkContext.clearFiles() from the PySpark API as it was removed from the Scala API prior to Spark 2.0.0

     Show description for b5bfcdd
     

     sjakthol

     authored and

     srowen

     committed
     b5bfcddView commit details

     Copy full SHA for b5bfcdd

     View code at this pointBrowse repository at this point
7. Commits on Sep 12, 2016

   • [SPARK-17474] [SQL] fix python udf in TakeOrderedAndProjectExec

     Show description for a91ab70
     

     Davies Liu

     authored and

     davies

     committed
     a91ab70View commit details

     Copy full SHA for a91ab70

     View code at this pointBrowse repository at this point
8. Commits on Sep 11, 2016

   • [SPARK-17389][FOLLOW-UP][ML] Change KMeans k-means|| default init steps from 5 to 2.

     Show description for 883c763
     

     yanboliang

     authored and

     srowen

     committed
     883c763View commit details

     Copy full SHA for 883c763

     View code at this pointBrowse repository at this point
9. Commits on Sep 6, 2016

   • [MINOR][ML] Correct weights doc of MultilayerPerceptronClassificationModel.

     Show description for 39d538d
     yanboliang

     committed
     39d538dView commit details

     Copy full SHA for 39d538d

     View code at this pointBrowse repository at this point
10. Commits on Sep 4, 2016

    • [SPARK-17311][MLLIB] Standardize Python-Java MLlib API to accept optional long seeds in all cases

      Show description for cdeb97a
      srowen

      committed
      cdeb97aView commit details

      Copy full SHA for cdeb97a

      View code at this pointBrowse repository at this point
11. Commits on Sep 2, 2016

    • [SPARK-17298][SQL] Require explicit CROSS join for cartesian products

      Show description for e6132a6
      

      srinathshankar

      authored and

      hvanhovell

      committed
      e6132a6View commit details

      Copy full SHA for e6132a6

      View code at this pointBrowse repository at this point

    • [SPARK-17261] [PYSPARK] Using HiveContext after re-creating SparkContext in Spark 2.0 throws "Java.lang.illegalStateException: Cannot call methods on a stopped sparkContext"

      Show description for ea66228
      

      zjffdu

      authored and

      davies

      committed
      ea66228View commit details

      Copy full SHA for ea66228

      View code at this pointBrowse repository at this point
12. Commits on Aug 30, 2016

    • [SPARK-17264][SQL] DataStreamWriter should document that it only supports Parquet for now

      Show description for befab9c
      srowen

      committed
      befab9cView commit details

      Copy full SHA for befab9c

      View code at this pointBrowse repository at this point
13. Commits on Aug 27, 2016

    • [SPARK-17001][ML] Enable standardScaler to standardize sparse vectors when withMean=True

      Show description for e07baf1
      srowen

      committed
      e07baf1View commit details

      Copy full SHA for e07baf1

      View code at this pointBrowse repository at this point
14. Commits on Aug 25, 2016

    • [SPARK-17197][ML][PYSPARK] PySpark LiR/LoR supports tree aggregation level configurable.

      Show description for 6b8cb1f
      yanboliang

      committed
      6b8cb1fView commit details

      Copy full SHA for 6b8cb1f

      View code at this pointBrowse repository at this point

    • [SPARK-17215][SQL] Method `SQLContext.parseDataType(dataTypeString: String)` could be removed.

      Show description for 5f02d2e
      

      jiangxb1987

      authored and

      rxin

      committed
      5f02d2eView commit details

      Copy full SHA for 5f02d2e

      View code at this pointBrowse repository at this point
15. Commits on Aug 24, 2016

    • [SPARK-16216][SQL] Read/write timestamps and dates in ISO 8601 and dateFormat/timestampFormat option for CSV and JSON

      Show description for 29952ed
      

      HyukjinKwon

      authored and

      hvanhovell

      committed
      29952edView commit details

      Copy full SHA for 29952ed

      View code at this pointBrowse repository at this point

    • [SPARK-16781][PYSPARK] java launched by PySpark as gateway may not be the same java used in the spark environment

      Show description for 0b3a4be
      srowen

      committed
      0b3a4beView commit details

      Copy full SHA for 0b3a4be

      View code at this pointBrowse repository at this point
16. Commits on Aug 22, 2016

    • [SPARK-15113][PYSPARK][ML] Add missing num features num classes

      Show description for b264cbb
      

      holdenk

      authored and

      Nick Pentreath

      committed
      b264cbbView commit details

      Copy full SHA for b264cbb

      View code at this pointBrowse repository at this point
17. Commits on Aug 20, 2016

    • [SPARK-15018][PYSPARK][ML] Improve handling of PySpark Pipeline when used without stages

      Show description for 39f328b
      

      BryanCutler

      authored and

      yanboliang

      committed
      39f328bView commit details

      Copy full SHA for 39f328b

      View code at this pointBrowse repository at this point
18. Commits on Aug 19, 2016

    • [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for SparseVector.

      Show description for 072acf5
      

      zjffdu

      authored and

      srowen

      committed
      072acf5View commit details

      Copy full SHA for 072acf5

      View code at this pointBrowse repository at this point

    • [SPARK-16961][CORE] Fixed off-by-one error that biased randomizeInPlace

      Show description for 5377fc6
      

      nicklavers

      authored and

      srowen

      committed
      5377fc6View commit details

      Copy full SHA for 5377fc6

      View code at this pointBrowse repository at this point
19. Commits on Aug 17, 2016

    • [MINOR][DOC] Fix the descriptions for `properties` argument in the documenation for jdbc APIs

      Show description for 0f6aa8a
      

      mvervuurt

      authored and

      rxin

      committed
      0f6aa8aView commit details

      Copy full SHA for 0f6aa8a

      View code at this pointBrowse repository at this point
20. Commits on Aug 16, 2016

    • [SPARK-17035] [SQL] [PYSPARK] Improve Timestamp not to lose precision for all cases

      Show description for 12a89e5
      

      dongjoon-hyun

      authored and

      davies

      committed
      12a89e5View commit details

      Copy full SHA for 12a89e5

      View code at this pointBrowse repository at this point
21. Commits on Aug 15, 2016

    • [SPARK-16700][PYSPARK][SQL] create DataFrame from dict/Row with schema

      Show description for fffb0c0
      

      Davies Liu

      authored and

      JoshRosen

      committed
      fffb0c0View commit details

      Copy full SHA for fffb0c0

      View code at this pointBrowse repository at this point
22. Commits on Aug 12, 2016

    • [MINOR][ML] Rename TreeEnsembleModels to TreeEnsembleModel for PySpark

      Show description for ccc6dc0
      yanboliang

      committed
      ccc6dc0View commit details

      Copy full SHA for ccc6dc0

      View code at this pointBrowse repository at this point
23. Commits on Aug 10, 2016

    • [SPARK-16324][SQL] regexp_extract should doc that it returns empty string when match fails

      Show description for 0578ff9
      srowen

      committed
      0578ff9View commit details

      Copy full SHA for 0578ff9

      View code at this pointBrowse repository at this point
24. Commits on Aug 9, 2016

    • [SPARK-16950] [PYSPARK] fromOffsets parameter support in KafkaUtils.createDirectStream for python3

      Show description for 29081b5
      

      Mariusz Strzelecki

      authored and

      davies

      committed
      29081b5View commit details

      Copy full SHA for 29081b5

      View code at this pointBrowse repository at this point
25. Commits on Aug 7, 2016

    • [SPARK-16409][SQL] regexp_extract with optional groups causes NPE

      Show description for 8d87252
      srowen

      committed
      8d87252View commit details

      Copy full SHA for 8d87252

      View code at this pointBrowse repository at this point
26. Commits on Aug 6, 2016

    • [SPARK-16772][PYTHON][DOCS] Fix API doc references to UDFRegistration + Update "important classes"

      Show description for 2dd0388
      

      nchammas

      authored and

      srowen

      committed
      2dd0388View commit details

      Copy full SHA for 2dd0388

      View code at this pointBrowse repository at this point