'Manage dataframes in C#/.NET and saving to parquet
I need to build a .NET library to unpack data currently stored in a proprietary format. I want to store the data in a columnar, compressed format, preferably in parquet files.
There are several libraries that enables pandas-like dataframes, like deedle or the dataframe class in the Microsoft.Data.Analysis library. However, none of these libraries offers a native write to parquet method, similar to the df.to_parquet() method of pandas.
Any suggestions on on how this can be resolved without the need to implement low level code? Integrating with the Parquet.Net library does not seem straight forward, am no C# or .NET expert.
Sources
This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.
Source: Stack Overflow
| Solution | Source |
|---|