orderBy (ウィンドウ)

順序が定義された WindowSpec を作成します。

構文

Window.orderBy(*cols)

パラメーター

返品

WindowSpec

例示

from pyspark.sql import Window, functions as sf

df = spark.createDataFrame(
    [(1, "a"), (1, "a"), (2, "a"), (1, "b"), (2, "b"), (3, "b")], ["id", "category"])

# Show row number ordered by category in each id partition.
window = Window.partitionBy("id").orderBy("category")
df.withColumn("row_number", sf.row_number().over(window)).show()
# +---+--------+----------+
# | id|category|row_number|
# +---+--------+----------+
# |  1|       a|         1|
# |  1|       a|         2|
# |  1|       b|         3|
# |  2|       a|         1|
# |  2|       b|         2|
# |  3|       b|         1|
# +---+--------+----------+