spark_write_parquet {sparklyr} | R Documentation |
Serialize a Spark DataFrame to the Parquet format.
spark_write_parquet(x, path, mode = NULL, options = list(), partition_by = NULL, ...)
x |
A Spark DataFrame or dplyr operation |
path |
The path to the file. Needs to be accessible from the cluster. Supports the "hdfs://", "s3a://" and "file://" protocols. |
mode |
A For more details see also http://spark.apache.org/docs/latest/sql-programming-guide.html#save-modes for your version of Spark. |
options |
A list of strings with additional options. See http://spark.apache.org/docs/latest/sql-programming-guide.html#configuration. |
partition_by |
A |
... |
Optional arguments; currently unused. |
Other Spark serialization routines: spark_load_table
,
spark_read_csv
,
spark_read_jdbc
,
spark_read_json
,
spark_read_libsvm
,
spark_read_parquet
,
spark_read_source
,
spark_read_table
,
spark_read_text
,
spark_save_table
,
spark_write_csv
,
spark_write_jdbc
,
spark_write_json
,
spark_write_source
,
spark_write_table
,
spark_write_text