12,116 questions with Azure Data Factory tags

Sort by: Updated
2 answers

ErrorCode=SftpPermissionDenied using copy activity in ADF

I'm trying to migrate data from File server to ADLS. All the access permissions has been granted for my id. but there are some restricted files due to which pipeline is getting failed. Is there are any way we can setup a pipeline where we can ignore…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-06T13:18:57.3233333+00:00
Bhupinder Singh 0 Reputation points
commented 2026-04-07T19:04:07.33+00:00
Manoj Kumar Boyini 11,355 Reputation points Microsoft External Staff Moderator
1 answer

Multiple pipelines using ADF custom activity failing due to InvalidXmlNodeValue error

I have multiple pipelines that use ADF Custom Activity with a Batch Account, and they normally run successfully. However, they have been failing consistently for the past 3 days with the error: “The value for one of the XML nodes is not in the correct…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-07T09:16:17.2+00:00
Alankritha C H 0 Reputation points Microsoft Employee
answered 2026-04-07T15:10:12.9966667+00:00
Amira Bedhiafi 41,131 Reputation points Volunteer Moderator
3 answers

Unable to authenticate my local folder to cloud server

Hi Azure Team, I am unable to connect local folder from my machine to azure cloud with file system linked service and SHIR I have cd "C:\Program Files\Microsoft Integration Runtime\5.0\Shared" and .\dmgcmd.exe -DisableLocalFolderPathValidation…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-05T07:54:11.0933333+00:00
trupti bedre 0 Reputation points
commented 2026-04-07T09:54:25.2766667+00:00
Pilladi Padma Sai Manisha 6,430 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Cannot get data from azure data lake gen2 Common Data Model

Hello, I tried to export data from my data lake storage with a dataflow in Azure Data Factory, the data structure seems good and I have the lines but I don't have any data appearing in the fields: I have tried with the scheme derivation and without it,…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-03-31T14:44:22.3833333+00:00
OUADAH Djilali 25 Reputation points
accepted 2026-04-07T09:46:09.7+00:00
OUADAH Djilali 25 Reputation points
2 answers One of the answers was accepted by the question author.

Azure Data Factory-Private Connectivity

Can ADF worskapce be made private as like Databricks workspace. If used without VPN should throw error. How to confirm private connectivity of ADF. Linked service test connection which uses SHIR is successful without VPN. DNS resolution of ADF portal is…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-03T08:03:47.91+00:00
Shubhangi Nannware 60 Reputation points
accepted 2026-04-06T07:49:29.8566667+00:00
Shubhangi Nannware 60 Reputation points
6 answers

How to fix Sharepoint ErrorCode=HttpRequestFailedWithUnauthorizedError, Unauthorized, usually this is caused by invalid credentials, while downloading data from sharepoint online to blob using ADF

Hi Everyone Hope your doing good. Iam facing an issue while downloading files from sharepoint online using ADF.. for this process I registred app in azure and then grant the application access to the sharepoint online site ..after this i created pipeline…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2023-10-12T08:10:39.31+00:00
Prashant Joshi 0 Reputation points
commented 2026-04-03T15:41:04.2966667+00:00
Viswa Prasad Pullela 0 Reputation points
2 answers

- descriptionOfIssue: We upgraded from Azure Data Factory Linked Service Oracle v1 to Oracle v2 due to v1 deprecating on 3/31/2026. We are seeing intermittent ORA-12650: No common encryption or data integrity algorithm errors. If we retry the pipeline, it

descriptionOfIssue: We upgraded from Azure Data Factory Linked Service Oracle v1 to Oracle v2 due to v1 deprecating on 3/31/2026. We are seeing intermittent ORA-12650: No common encryption or data integrity algorithm errors. If we retry the pipeline,…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-03T01:27:00.1466667+00:00
rajesh kumar 25 Reputation points
answered 2026-04-03T08:08:23.9533333+00:00
Smaran Thoomu 34,795 Reputation points Microsoft External Staff Moderator
3 answers

Locating the pipeline environment parameter setting?

How do I locate the pipeline environment parameter setting?

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-03-30T15:26:10.8533333+00:00
Kessler Kelly 0 Reputation points
answered 2026-04-03T07:24:59.8233333+00:00
Smaran Thoomu 34,795 Reputation points Microsoft External Staff Moderator
2 answers

Oracle V2 Connector Datatype Error

I migrated to the Oracle V2 connector. My pipelines are failing as I'm receiving the following error message for several fields for each table on the source side.  …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-01T16:20:48.9366667+00:00
Anic, Benjamin 0 Reputation points
commented 2026-04-02T22:48:02.6366667+00:00
Pilladi Padma Sai Manisha 6,430 Reputation points Microsoft External Staff Moderator
2 answers

Looking for ADF to connect on-prem SQL server. Need help or suggestions

Hello Cloud Gurus, I have a required in setting up the On-prem SQL server connectivity through ADF for the DB migration project. Please share as i am looking for the instructions on the pre-requisites to setup on this and a detailed notes if any. Do I…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-01T15:30:40.43+00:00
Althaf Hussain Shaik 0 Reputation points
edited an answer 2026-04-02T04:43:25.3566667+00:00
Nandan Hegde 36,796 Reputation points MVP Volunteer Moderator
2 answers One of the answers was accepted by the question author.

Is there way to create dataset on multiple tables together?

I have a question for Azure Data Factory. I am trying to create datasets for 50 tables in VM SQL database and moving data into each corresponding 50 tables Azure SQL database. On the process of creating datasets, is there way to select possibly all…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-03-24T20:50:26.7133333+00:00
Justin Doh 1,000 Reputation points
accepted 2026-04-01T23:01:40.5766667+00:00
Justin Doh 1,000 Reputation points
3 answers One of the answers was accepted by the question author.

Why does Azure Data Factory take ~20 seconds to execute a simple query that runs in milliseconds in MySQL?

Why does Azure Data Factory take ~20 seconds to execute a simple query that runs in milliseconds in MySQL? I have a pipeline that executes a simple update/lookup query on Azure MySQL. The query itself takes less than 1 second, but the pipeline activity…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-03-31T03:30:18.9366667+00:00
Kien Ngo 40 Reputation points
commented 2026-04-01T16:24:18.2533333+00:00
SAI JAGADEESH KUDIPUDI 1,600 Reputation points Microsoft External Staff Moderator
2 answers

ODBC connection errors from Data Factory

I have some Data Factory pipelines that have been running fine for years. Today, (4/1) I started to get this error message: ERROR [IM002] [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified I traced it back to the…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-01T14:28:35.53+00:00
Jeff Geitz 0 Reputation points
answered 2026-04-01T15:38:15.1333333+00:00
Manoj Kumar Boyini 11,355 Reputation points Microsoft External Staff Moderator
0 answers

We came across continues bad request error code, detail shows - Operation on target UntilCheckApprovalRequest failed: Activity timed out.

We came across continues bad request error code, detail shows - Operation on target UntilCheckApprovalRequest failed: Activity timed out.

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-04-01T06:47:58.0733333+00:00
Na Li 0 Reputation points Microsoft Employee
commented 2026-04-01T07:39:09.8833333+00:00
SAI JAGADEESH KUDIPUDI 1,600 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Analyze the message log of an activity running in the ADF pipeline.

Message from gateway host 15dbf5f0-513d-4284-bda5- Retrieving 52ea5cc34174. worker: c1799ef9-d34a-4442-b353- ce65ee2f3693、ProcessID 10868 Activity ID: 15dbf5f0-513d-4284-bda5-52ea5cc34174 IsSecondary False, StartPullTaskHA continues on condition: task is…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-03-31T06:47:38.0066667+00:00
Kien Ngo 40 Reputation points
commented 2026-03-31T22:29:41.34+00:00
Pilladi Padma Sai Manisha 6,430 Reputation points Microsoft External Staff Moderator
2 answers

ADF pipeline copy from one adf to another adf

Hi Team, Can someone help me to share the steps copy pipeline from one adf to another adf. Regards Saim

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-03-27T19:46:28.2966667+00:00
shamim 0 Reputation points
commented 2026-03-31T21:22:40.02+00:00
Pilladi Padma Sai Manisha 6,430 Reputation points Microsoft External Staff Moderator
1 answer

Azure Data Factory Integration Runtime startup time for each activity

Azure Data Factory Integration Runtime startup time for each activity

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-03-31T03:50:39.5466667+00:00
Kien Ngo 40 Reputation points
edited an answer 2026-03-31T07:20:27.51+00:00
Smaran Thoomu 34,795 Reputation points Microsoft External Staff Moderator
1 answer

Pipeline Activities are running very slow

Hi..Earlier pipelines were running an average of 3min...Now same pipelineS and same data load taking hours to execute. I have tested procedures in SQL DB they are running fine. I think the issue might be with self-hosted IR. Please find the below IR's…

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2021-01-25T10:50:55.757+00:00
THIMMAIAH GARI,PRASHANTH,, 201 Reputation points
answered 2026-03-31T03:26:11.1866667+00:00
Kien Ngo 40 Reputation points
2 answers

How to upgrade the latest version for a linked service in ADF? When we upgrade, what kinds of issues can you face? What is a frequency?

How to upgrade the latest version for a linked service in ADF? When we upgrade, what kinds of issues can you face? What is a frequency?

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2025-07-12T10:04:01.3966667+00:00
Anandhswarupp 205 Reputation points
answered 2026-03-30T09:24:09.9866667+00:00
nadhira thembavani 0 Reputation points
1 answer

Why does my C# code keep failing with “Resource cannot be updated during provisioning” even after multiple retries and delays?

"error": { "code": "BadRequest", "message": "Resource cannot be updated during provisioning", "target": "orbitaxbdltdstorageventtrigger", "details": null } code: …

Azure Data Factory
Azure Data Factory

An Azure service for ingesting, preparing, and transforming data at scale.

12,116 questions
asked 2026-03-24T10:01:41.33+00:00
Rifatul Islam 0 Reputation points
commented 2026-03-29T22:32:23.8833333+00:00
Divyesh Govaerdhanan 10,850 Reputation points Volunteer Moderator