An Azure service for ingesting, preparing, and transforming data at scale.
ErrorCode=SftpPermissionDenied using copy activity in ADF
I'm trying to migrate data from File server to ADLS. All the access permissions has been granted for my id. but there are some restricted files due to which pipeline is getting failed. Is there are any way we can setup a pipeline where we can ignore…
Azure Data Factory
Multiple pipelines using ADF custom activity failing due to InvalidXmlNodeValue error
I have multiple pipelines that use ADF Custom Activity with a Batch Account, and they normally run successfully. However, they have been failing consistently for the past 3 days with the error: “The value for one of the XML nodes is not in the correct…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Unable to authenticate my local folder to cloud server
Hi Azure Team, I am unable to connect local folder from my machine to azure cloud with file system linked service and SHIR I have cd "C:\Program Files\Microsoft Integration Runtime\5.0\Shared" and .\dmgcmd.exe -DisableLocalFolderPathValidation…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Cannot get data from azure data lake gen2 Common Data Model
Hello, I tried to export data from my data lake storage with a dataflow in Azure Data Factory, the data structure seems good and I have the lines but I don't have any data appearing in the fields: I have tried with the scheme derivation and without it,…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory-Private Connectivity
Can ADF worskapce be made private as like Databricks workspace. If used without VPN should throw error. How to confirm private connectivity of ADF. Linked service test connection which uses SHIR is successful without VPN. DNS resolution of ADF portal is…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to fix Sharepoint ErrorCode=HttpRequestFailedWithUnauthorizedError, Unauthorized, usually this is caused by invalid credentials, while downloading data from sharepoint online to blob using ADF
Hi Everyone Hope your doing good. Iam facing an issue while downloading files from sharepoint online using ADF.. for this process I registred app in azure and then grant the application access to the sharepoint online site ..after this i created pipeline…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
- descriptionOfIssue: We upgraded from Azure Data Factory Linked Service Oracle v1 to Oracle v2 due to v1 deprecating on 3/31/2026. We are seeing intermittent ORA-12650: No common encryption or data integrity algorithm errors. If we retry the pipeline, it
descriptionOfIssue: We upgraded from Azure Data Factory Linked Service Oracle v1 to Oracle v2 due to v1 deprecating on 3/31/2026. We are seeing intermittent ORA-12650: No common encryption or data integrity algorithm errors. If we retry the pipeline,…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Locating the pipeline environment parameter setting?
How do I locate the pipeline environment parameter setting?
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Oracle V2 Connector Datatype Error
I migrated to the Oracle V2 connector. My pipelines are failing as I'm receiving the following error message for several fields for each table on the source side. …
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Looking for ADF to connect on-prem SQL server. Need help or suggestions
Hello Cloud Gurus, I have a required in setting up the On-prem SQL server connectivity through ADF for the DB migration project. Please share as i am looking for the instructions on the pre-requisites to setup on this and a detailed notes if any. Do I…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Is there way to create dataset on multiple tables together?
I have a question for Azure Data Factory. I am trying to create datasets for 50 tables in VM SQL database and moving data into each corresponding 50 tables Azure SQL database. On the process of creating datasets, is there way to select possibly all…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Why does Azure Data Factory take ~20 seconds to execute a simple query that runs in milliseconds in MySQL?
Why does Azure Data Factory take ~20 seconds to execute a simple query that runs in milliseconds in MySQL? I have a pipeline that executes a simple update/lookup query on Azure MySQL. The query itself takes less than 1 second, but the pipeline activity…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ODBC connection errors from Data Factory
I have some Data Factory pipelines that have been running fine for years. Today, (4/1) I started to get this error message: ERROR [IM002] [Microsoft][ODBC Driver Manager] Data source name not found and no default driver specified I traced it back to the…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
We came across continues bad request error code, detail shows - Operation on target UntilCheckApprovalRequest failed: Activity timed out.
We came across continues bad request error code, detail shows - Operation on target UntilCheckApprovalRequest failed: Activity timed out.
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Analyze the message log of an activity running in the ADF pipeline.
Message from gateway host 15dbf5f0-513d-4284-bda5- Retrieving 52ea5cc34174. worker: c1799ef9-d34a-4442-b353- ce65ee2f3693、ProcessID 10868 Activity ID: 15dbf5f0-513d-4284-bda5-52ea5cc34174 IsSecondary False, StartPullTaskHA continues on condition: task is…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
ADF pipeline copy from one adf to another adf
Hi Team, Can someone help me to share the steps copy pipeline from one adf to another adf. Regards Saim
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Azure Data Factory Integration Runtime startup time for each activity
Azure Data Factory Integration Runtime startup time for each activity
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Pipeline Activities are running very slow
Hi..Earlier pipelines were running an average of 3min...Now same pipelineS and same data load taking hours to execute. I have tested procedures in SQL DB they are running fine. I think the issue might be with self-hosted IR. Please find the below IR's…
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
How to upgrade the latest version for a linked service in ADF? When we upgrade, what kinds of issues can you face? What is a frequency?
How to upgrade the latest version for a linked service in ADF? When we upgrade, what kinds of issues can you face? What is a frequency?
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
Why does my C# code keep failing with “Resource cannot be updated during provisioning” even after multiple retries and delays?
"error": { "code": "BadRequest", "message": "Resource cannot be updated during provisioning", "target": "orbitaxbdltdstorageventtrigger", "details": null } code: …
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.