'Azure Copy Files from AZDatalake to AZBlob sorage Dynamic

I want to copy files from azure data lake storage to azure blob storage. when i use static file name it's copying successfully but it is not getting success while using dynamic file name.

I have followed same process as per below blog but getting String type conversion error.

ErrorMessage: Error code : 2200

Failure type : User configuration issue

Details: ErrorCode=UserErrorInvalidValueInPayload,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Failed to convert the value in 'fileName' property to 'System.String' type. Please make sure the payload structure and value are correct.,Source=Microsoft.DataTransfer.DataContracts,''Type=System.InvalidCastException,Message=Object must implement IConvertible.,Source=mscorlib,'

Reference Blog : https://www.c-sharpcorner.com/article/extract-file-names-and-copy-from-source-path-in-azure-data-factory/



Solution 1:[1]

Set the "WILD CARD" filtering in the copy activity.

Set the wildcard folder path : rootFolder/subFolder/*/*/DestinationFolder

Choose the wildcard file name = * or *.json or *.txt or *.csv.., etc according to the requirement.

Check the following link for detailed understanding :

https://docs.microsoft.com/en-in/azure/data-factory/connector-azure-data-lake-store?tabs=data-factory#folder-and-file-filter-examples

Sources

This article follows the attribution requirements of Stack Overflow and is licensed under CC BY-SA 3.0.

Source: Stack Overflow

Solution Source
Solution 1 SairamTadepalli-MT