Commits

Breadcrumbs

History for

onmaster

User selector

All users

All time

Commit History

Commits on Sep 25, 2023

• [SPARK-45240][SQL][CONNECT] Implement Error Enrichment for Python Client

  Show description for 9139910
  

  heyihong

  authored and

  HyukjinKwon

  committed
  9139910

  Copy full SHA for 9139910

• [SPARK-45279][PYTHON][CONNECT] Attach plan_id for all logical plans

  Show description for 609552e
  zhengruifeng

  committed
  609552e

  Copy full SHA for 609552e

Commits on Sep 22, 2023

• [SPARK-45247][BUILD][PYTHON][PS] Upgrade Pandas to 2.1.1

  Show description for 4d43563
  

  itholic

  authored and

  dongjoon-hyun

  committed
  4d43563

  Copy full SHA for 4d43563

• [SPARK-44112][BUILD][INFRA][DOCS] Drop support for Java 8 and Java 11

  Show description for 46ebed2
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  46ebed2

  Copy full SHA for 46ebed2

• [SPARK-43655][CONNECT][PS][TESTS] Enable `NamespaceParityTests.test_get_index_map`

  Show description for 9cad22a
  

  itholic

  authored and

  dongjoon-hyun

  committed
  9cad22a

  Copy full SHA for 9cad22a

• [MINOR][PYTHON][TESTS] Add init file to pyspark.ml.deepspeed.tests

  Show description for 5f643ee
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  5f643ee

  Copy full SHA for 5f643ee

• [SPARK-44113][BUILD][INFRA][DOCS] Drop support for Scala 2.12

  Show description for 3429202
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  3429202

  Copy full SHA for 3429202

• [SPARK-45251][CONNECT] Add client_type field for FetchErrorDetails

  Show description for db02469
  

  heyihong

  authored and

  HyukjinKwon

  committed
  db02469

  Copy full SHA for db02469

• [SPARK-43433][PS] Match `GroupBy.nth` behavior to the latest Pandas

  Show description for 0bf950e
  

  itholic

  authored and

  HyukjinKwon

  committed
  0bf950e

  Copy full SHA for 0bf950e

• [SPARK-45093][CONNECT][PYTHON] Error reporting for addArtifacts query

  Show description for 555aece
  

  cdkrot

  authored and

  HyukjinKwon

  committed
  555aece

  Copy full SHA for 555aece

• [SPARK-41086][SQL] Use DataFrame ID to semantically validate CollectMetrics

  Show description for 7c3c7c5
  

  Rui Wang

  authored and

  cloud-fan

  committed
  7c3c7c5

  Copy full SHA for 7c3c7c5

Commits on Sep 21, 2023

• [SPARK-45219][PYTHON][DOCS] Refine docstring of withColumn(s)Renamed

  Show description for cf04bd9
  

  allisonwang-db

  and

  HyukjinKwon

  committed
  cf04bd9

  Copy full SHA for cf04bd9

• [SPARK-45235][CONNECT][PYTHON] Support map and array parameters by `sql()`

  Show description for a2bab5e
  MaxGekk

  committed
  a2bab5e

  Copy full SHA for a2bab5e

• [MINOR][DOCS][CONNECT] Update notes about supported modules in PySpark API reference

  Show description for a0ffb2e
  HyukjinKwon

  committed
  a0ffb2e

  Copy full SHA for a0ffb2e

• [SPARK-45216][SQL] Fix non-deterministic seeded Dataset APIs

  Show description for 14ba4fc
  

  peter-toth

  authored and

  HyukjinKwon

  committed
  14ba4fc

  Copy full SHA for 14ba4fc

Commits on Sep 20, 2023

• [SPARK-45107][PYTHON][DOCS] Refine docstring of explode

  Show description for c1dc9ae
  

  allisonwang-db

  authored and

  zhengruifeng

  committed
  c1dc9ae

  Copy full SHA for c1dc9ae

• [SPARK-45218][PYTHON][DOCS] Refine docstring of Column.isin

  Show description for 76acd12
  

  allisonwang-db

  authored and

  zhengruifeng

  committed
  76acd12

  Copy full SHA for 76acd12

• [SPARK-45234][PYTHON][DOCS] Refine DocString of `regr_*` functions

  Show description for e9e9320
  zhengruifeng

  committed
  e9e9320

  Copy full SHA for e9e9320

• [SPARK-45112][SQL] Use UnresolvedFunction based resolution in SQL Dataset functions

  Show description for 288a92b
  

  peter-toth

  authored and

  cloud-fan

  committed
  288a92b

  Copy full SHA for 288a92b

• [SPARK-45224][PYTHON] Add examples w/ map and array as parameters of `sql()`

  Show description for c89221b
  MaxGekk

  committed
  c89221b

  Copy full SHA for c89221b

• [SPARK-43498][PS][TESTS] Enable `StatsTests.test_axis_on_dataframe` for pandas 2.0.0

  Show description for 27dc7ff
  

  itholic

  authored and

  HyukjinKwon

  committed
  27dc7ff

  Copy full SHA for 27dc7ff

• [SPARK-45226][PYTHON][DOCS] Refine docstring of `rand/randn`

  Show description for ad18393
  

  panbingkun

  authored and

  zhengruifeng

  committed
  ad18393

  Copy full SHA for ad18393

• [SPARK-44622][SQL][CONNECT] Implement FetchErrorDetails RPC

  Show description for 48b1a28
  

  heyihong

  authored and

  hvanhovell

  committed
  48b1a28

  Copy full SHA for 48b1a28

• [SPARK-44463][SS][CONNECT] Improve error handling for Connect steaming Python worker

  Show description for d62a8e6
  

  bogao007

  authored and

  HyukjinKwon

  committed
  d62a8e6

  Copy full SHA for d62a8e6

Commits on Sep 19, 2023

• [SPARK-43453][PS] Ignore the `names` of `MultiIndex` when `axis=1` for `concat`

  Show description for 9fb4445
  

  itholic

  authored and

  dongjoon-hyun

  committed
  9fb4445

  Copy full SHA for 9fb4445

• [SPARK-43654][CONNECT][PS][TESTS] Enable `InternalFrameParityTests.test_from_pandas`

  Show description for 2697a94
  

  itholic

  authored and

  dongjoon-hyun

  committed
  2697a94

  Copy full SHA for 2697a94

Commits on Sep 18, 2023

• [SPARK-45113][PYTHON][DOCS][FOLLOWUP] Add sorting to the example of `collect_set/collect_list` to ensure stable results

  Show description for 464a3c1
  

  LuciferYang

  authored and

  HyukjinKwon

  committed
  464a3c1

  Copy full SHA for 464a3c1

• [SPARK-45065][PYTHON][PS] Support Pandas 2.1.0

  Show description for f83e5ec
  

  2 peopleauthored and

  dongjoon-hyun

  committed
  f83e5ec

  Copy full SHA for f83e5ec

• [SPARK-45188][SQL][DOCS] Update error messages related to parameterized `sql()`

  Show description for 9813122
  MaxGekk

  committed
  9813122

  Copy full SHA for 9813122

• [SPARK-45137][CONNECT] Support map/array parameters in parameterized `sql()`

  Show description for 0dda75f
  MaxGekk

  committed
  0dda75f

  Copy full SHA for 0dda75f

• [SPARK-45196][PYTHON][DOCS] Refine docstring of `array/array_contains/arrays_overlap`

  Show description for 8d363c6
  

  LuciferYang

  authored and

  dongjoon-hyun

  committed
  8d363c6

  Copy full SHA for 8d363c6

• [SPARK-43628][SPARK-43629][CONNECT][PS][TESTS] Clear message for JVM dependent tests

  Show description for 02bbd28
  

  itholic

  authored and

  dongjoon-hyun

  committed
  02bbd28

  Copy full SHA for 02bbd28

• [SPARK-44788][PYTHON][DOCS][FOLLOW-UP] Move `from_xml`/`schema_of_xml` to `Xml Functions`

  Show description for 82d0823
  

  zhengruifeng

  authored and

  dongjoon-hyun

  committed
  82d0823

  Copy full SHA for 82d0823

• [SPARK-44788][PYTHON][DOCS][FOLLOW-UP] Add from_xml and schema_of_xml into PySpark documentation

  Show description for 5b89bc1
  

  HyukjinKwon

  authored and

  dongjoon-hyun

  committed
  5b89bc1

  Copy full SHA for 5b89bc1

• [SPARK-45193][PS][CONNECT][TESTS] Refactor `test_mode` to be compatible with Spark Connect

  Show description for 5db824a
  zhengruifeng

  committed
  5db824a

  Copy full SHA for 5db824a