Backup of ADF pipelines

Question

Backup of ADF pipelines

Kundan Ray 0

Hi Everyone,

I am looking for backup of ADF including pipelines, datasets and dataflows. Please find the snapshot, how to take backup of this so that I can restore it when required. User's image

Smaran Thoomu 28,225 Reputation points Microsoft External Staff Moderator

2025-08-06T21:02:31.07+00:00

Kundan Ray Just checking in to see if the below answer provided helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

1 answer

Your answer

Smaran Thoomu 28,225 Reputation points Microsoft External Staff Moderator

2025-08-06T21:02:31.07+00:00

Kundan Ray Just checking in to see if the below answer provided helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Answer 1

Nandan Hegde 36,396 MVP Volunteer Moderator

Ideally the best way to preserve the backup of the ADF is :

Do GIT integration of the ADF. It would preserve all the JSON code of the underlying Linked services, datasets , pipelines etc.
If you have not GIT integrated, you can export the ARM templates

Nandan Hegde 36,396 Reputation points MVP Volunteer Moderator

2025-08-05T07:51:22.0833333+00:00

https://stackoverflow.com/questions/74131748/how-to-implement-disaster-recovery-for-azure-data-factory
Smaran Thoomu 28,225 Reputation points Microsoft External Staff Moderator

2025-08-07T17:33:13.71+00:00

Hi Kundan Ray

Thanks again for your feedback. We noticed that you marked the previous answer as not helpful, and we truly appreciate you taking the time to share that. We’re here to help and always looking to improve.

The response provided earlier by @Nandan Hegde includes the recommended approaches to back up your Azure Data Factory resources - either by using Git integration for version control, or by exporting ARM templates if Git isn't enabled. These methods cover all components like pipelines, datasets, linked services, and dataflows. If you'd like more hands-on help with either method, just let me know - happy to assist further.

Also, if you feel the answer now addresses your query better, you’re welcome to revisit the thread and update your feedback or rating. Your input really helps us improve the support we provide to others in the community as well.

Looking forward to hearing back from you. Thanks again for helping us improve!
Smaran Thoomu 28,225 Reputation points Microsoft External Staff Moderator

2025-08-08T20:19:59.92+00:00

Kundan Ray Just checking in to see if the above answer provided helped. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.
Kundan Ray 0 Reputation points

2025-08-09T12:14:32.2666667+00:00

Hi @Smaran Thoomu ,
Please provide the answer for this. ARM template will not cover the IR, Linked Services and other components.

Please provide more context using Git integration. How to do this activity and how to restore backup.
Smaran Thoomu 28,225 Reputation points Microsoft External Staff Moderator

2025-08-11T18:20:06.4966667+00:00
Hi Kundan Ray

Thanks for clarifying your concern. You’re correct that exporting ARM templates alone will not cover all components such as Integration Runtimes, certain Linked Services (especially those with credential dependencies), and other runtime settings.

For a more complete backup and restore strategy, Git integration is the recommended approach for Azure Data Factory:

Enable Git Integration

In your Data Factory studio, go to Manage → Git Configuration.

Connect to an Azure DevOps or GitHub repository.

This ensures that all JSON definitions for pipelines, datasets, dataflows, linked services, and triggers are automatically stored in source control.

Backup

Once integrated, every publish to the Data Factory will push JSON files to your Git repo.

You can create branches or tags in Git to capture backup states at specific points in time.

Restore

To restore a backup, you can switch to the branch/tag with the desired state in your Git repo, then publish those changes back to a new or existing Data Factory instance.

For Integration Runtimes, you may need to reconfigure them manually if they contain secure credentials, as secrets are not stored in JSON and must be re-entered.

References:

Set up Git integration in Azure Data Factory

CI/CD in Azure Data Factory

Hope this helps. If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

Share via

Backup of ADF pipelines

1 answer

Your answer