I'm having issues using parameter within a storage event trigger for the typeProperty "blobPathBeginsWith". Per default when using a storage event trigger, the
I am new to data flows in adf. I have a set of json files in a folder which i would like to parse and flatten two arrays into a csv. The json structure is as fo
I have a requirement to POST json data (stored as json files in ADLS) to REST API endpoint. I have to use Azure Data factory for this. I have gone through Micr
I have a strange source CSV file where it contains a trailing column delimiter at the end of each record just before the carriage return/new line. When ADF is
I am trying to import Google Analytics data into Azure Blob or Data Lake storage for analysis or reporting. But I don't see a Google Analytics connector in Azur
I am trying to do a lookup from a sql server table. I am able to connect to the sql server instance via MSSQL management studio, but in ADF I get the below erro
I have a pipeline that copies data from source (dynamics) to SQL server datawarehouse. There is a ForEach activity which iterates over the list of all the table
I have ADF pipeline which execute SQL stored procedure (SP). The SQL SP returns output parameters. I would like to visualize the content of the output parameter
I have a copy task in ADF that is pulling data from a REST API into an Azure SQL Database. I've created the mappings, and pulled in a collection reference as fo
I have an Azure Data Factory pipeline with an xml file as a source. The target sink is an Oracle table containing a datetime column. The mapping for most of the
I have created storage event trigger in my Azure Data Factory. StorageV2 (general purpose v2) account has been configured with it, If file is place in input con
I am trying to contrast and find the exact behavior of ADF schedule triggers and ADF thumbing window triggers when a trigger starts before the previous pipeline
Background I have an ADF pipeline that takes jobs from a “3rd party” queue (ueing a REST call), completes jobs and marks the queued message as compl
I am using Copy and transform data from and to a REST endpoint by using Azure Data Factory to load a file from my Box.com account to an Azure Data Lake Gen2 (AD
We are reading csv file input which has two fields. Sample input file is given for reference source, balance 1,100 2, 200 I need to create a trailer record in
I am building an Azure Data Factory pipeline and I would like to know how to get this parameter into the python script. The python script is l
We have an Azure Data Lake Gen 2 which contains 100's of thousands of JSON messages that come in on a continuous basis. These files are stored in a folder struc
After generating ~90 different 100 mb gzip'd CSV files, I want to merge them all into a single file. Using the built-in merge option for a data copy process, it
I have XML file something like below and need to get all complex elements having different names but all ends with "_KEYS" and they are part of different segmen
I am trying to copy data from a REST API into an Azure SQL Database table. The copy data activity uses pagination and can run longer than 10 minutes after which