'I cannot save spark DataFram to csv in Jupyter notebook ,
Py4JJavaError Traceback (most recent call last) Untitled-2.ipynb Cell 13' in <cell line: 1>() ----> 1 dt_clean.write.csv('C:/Users/K/Desktop/Mywork/Cleaned_data.csv',)
File ~\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pyspark\sql\readwriter.py:1372, in DataFrameWriter.csv(self, path, mode, compression, sep, quote, escape, header, nullValue, escapeQuotes, quoteAll, dateFormat, timestampFormat, ignoreLeadingWhiteSpace, ignoreTrailingWhiteSpace, charToEscapeQuoteEscaping, encoding, emptyValue, lineSep) 1364 self.mode(mode) 1365 self._set_opts(compression=compression, sep=sep, quote=quote, escape=escape, header=header, 1366 nullValue=nullValue, escapeQuotes=escapeQuotes, quoteAll=quoteAll, 1367
Pls help me i want to save in csv file from spark dataframe
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|