'Azure Data Factory Data Flow - Parquet, Schema and Data Type "Any"

I have a Data Flow in Azure Data Factory who is reading data from a Parquet file. It works smooth for all the files except one. The Data Flow is failing with the error: Could not read or convert schema fro the file ... After going into debug mode, I realise that one of my column was treated by the data flow as data type any(see screenshot below). In the original file the schema read the type TIME_MILLIS for this column. How can I tell Data Flow to treat this column as Text at least?

enter image description here

enter image description here

azureazure-data-factorydataflow


Solution 1:[1]

If this is being inferred from the Import projection method automatically, you can try manually importing the schema from a file in the source dataset properties.

If that doesn't help, you can cast that specific column into required data type using Derived Column step with conversion functions.

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1 KarthikBhyresh-MT

Related Questions