Using Azure Data Factory to send Change Data Capture data from an Azure SQL Database to Azure Blob Storage Learn more about Azure Blob Storage here. Unstructured data is data that doesn’t adhere to a particular data model or definition, such as text or binary data. Blob storage is optimized for storing massive amounts of unstructured data. ![]() Learn more about Azure Data Factory here.Īzure Blob storage is Microsoft’s object storage solution for the cloud. You can create data integration solutions using the Data Factory service that can ingest data from various data stores, transform/process the data, and publish the result data to the data stores. Learn more about CDC here.Īzure Data Factory is a cloud-based data integration service that orchestrates and automates the movement and transformation of data. Table-valued functions are provided to allow systematic access to the change data. Column information and the metadata that is required to apply the changes to a target environment is captured for the modified rows and stored in change tables that mirror the column structure of the tracked source tables. This makes the details of the changes available in an easily consumed relational format. CDC records insert, update, and delete activity that applies to a table. In this tutorial, you will create an Azure Data Factory pipeline that copies change data from Change Data Capture tables in an Azure SQL database to Azure Blob Storage.Ĭhange Data Capture (CDC) is currently available in SQL Server (all supported versions), Azure SQL Managed Instance, and Azure SQL Database (Preview). You can view the release announcement here: ![]() This blog is part of the Change Data Capture in Azure SQL Databases Blog Series, which started with the announcement on releasing CDC in Azure SQL Databases in early June 2021.
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |