options (DataStreamWriter)

Adds multiple output options for the underlying data source.

Syntax

options(**options)

Parameters

Returns

DataStreamWriter

Examples

df = spark.readStream.format("rate").load()
df.writeStream.options(**{"k1": "v1", "k2": "v2"})
# <...streaming.readwriter.DataStreamWriter object ...>

Print 3 rows per batch without truncation:

import time
q = spark.readStream.format(
    "rate").option("rowsPerSecond", 10).load().writeStream.format(
        "console").options(numRows=3, truncate=False).start()
time.sleep(3)
q.stop()