'Getting error in storing the filename in the Azure Dataflow?

I am getting one excel file in data lake and I am exporting the excel file into Azure SQL database using Dataflow in the ADF.

I need to store the filename as a column in my data. I am following the below steps:

enter image description here

I am giving the column name called "filename" in the Column to store the file name section.

I can able to see the entire columns and my new column "filename" in the projection and inspect section. However, when I tried to see the preview data, I am getting the below error

enter image description here

Not sure what is the issue? I changed the column name but no success. Could anyone advise what is the issue?

azureazure-data-factoryazure-data-flow


Solution 1:[1]

As the error message states, there must be a column name Filename which already exists in the source file schema.

Your settings look correct and if you are facing the same error after changing the column name, try to refresh your dataset or remove and add the source dataset again. This can refresh your source schema if any to the latest.

enter image description here

enter image description here

enter image description here

enter image description here

If you have a file inside a subfolder, the filename column extracts the full file path which includes subfolders and filename (ex: /subfolder/filename).

In this case, extract only filename from the filename column using derived column transformation.

enter image description here

enter image description here

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1 NiharikaMoola-MT

Related Questions