I currently have a Data Pipeline within ADF that pulls data from multiple REST APIs, transforms the data and stores it in an Azure SQL Database and from there i
I have a question, hopefully someone in the forum could give some help here. I am able to pull data from Soap API call to SQL Server table (xml data type field
I have set a storage event trigger for the pipelines in the azure data factory Dev environment. the blob path begins with is different in the dev environment an
I have a an api that contains some data and another api url named "nextapi" I want to loop through each api under api and store the data of each api page to azu
I am deploying ADF linked templates from ADLS through GitHub Actions and pipeline fails withy generic Python error: ERROR: 'str' object has no attribute 'get' I
I'm having issues using parameter within a storage event trigger for the typeProperty "blobPathBeginsWith". Per default when using a storage event trigger, the
I am new to data flows in adf. I have a set of json files in a folder which i would like to parse and flatten two arrays into a csv. The json structure is as fo
I have a requirement to POST json data (stored as json files in ADLS) to REST API endpoint. I have to use Azure Data factory for this. I have gone through Micr
I have a strange source CSV file where it contains a trailing column delimiter at the end of each record just before the carriage return/new line. When ADF is
I am trying to import Google Analytics data into Azure Blob or Data Lake storage for analysis or reporting. But I don't see a Google Analytics connector in Azur
I am trying to do a lookup from a sql server table. I am able to connect to the sql server instance via MSSQL management studio, but in ADF I get the below erro
I have a pipeline that copies data from source (dynamics) to SQL server datawarehouse. There is a ForEach activity which iterates over the list of all the table
I have ADF pipeline which execute SQL stored procedure (SP). The SQL SP returns output parameters. I would like to visualize the content of the output parameter
I have a copy task in ADF that is pulling data from a REST API into an Azure SQL Database. I've created the mappings, and pulled in a collection reference as fo
I have an Azure Data Factory pipeline with an xml file as a source. The target sink is an Oracle table containing a datetime column. The mapping for most of the
I have created storage event trigger in my Azure Data Factory. StorageV2 (general purpose v2) account has been configured with it, If file is place in input con
I am trying to contrast and find the exact behavior of ADF schedule triggers and ADF thumbing window triggers when a trigger starts before the previous pipeline
Background I have an ADF pipeline that takes jobs from a “3rd party” queue (ueing a REST call), completes jobs and marks the queued message as compl
I am using Copy and transform data from and to a REST endpoint by using Azure Data Factory to load a file from my Box.com account to an Azure Data Lake Gen2 (AD
We are reading csv file input which has two fields. Sample input file is given for reference source, balance 1,100 2, 200 I need to create a trailer record in