format (DataFrameWriter)

Specifies the underlying output data source.

Syntax

format(source)

Parameters

Returns

DataFrameWriter

Examples

Write a DataFrame into a Parquet file and read it back.

import tempfile
with tempfile.TemporaryDirectory(prefix="format") as d:
    spark.createDataFrame(
        [{"age": 100, "name": "Alice"}]
    ).write.mode("overwrite").format("parquet").save(d)

    spark.read.format('parquet').load(d).show()
    # +---+------------+
    # |age|        name|
    # +---+------------+
    # |100|Alice|
    # +---+------------+