'How to convert pyarrow.Table to PySpark Dataframe?
I have a pyarrow.Table object that I want to pass to PySpark (and save as a Spark table).
How can I convert pyarrow.Talbe to pyspark.sql.DataFrame?
The only way I can see it to convert it to pandas.DataFrame, but aren't there some more direct and reliable ways?
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|