Proposed Pull Request Change

📄 Document Links

View on GitHub View on Microsoft Learn

--- title: Push Data Factory lineage data to Microsoft Purview description: Learn about how to push Data Factory lineage data to Microsoft Purview ms.author: jianleishen author: jianleishen ms.topic: tutorial ms.custom: references_regions ms.date: 10/03/2024 ms.subservice: monitoring --- # Push Data Factory lineage data to Microsoft Purview [!INCLUDE[appliesto-adf-xxx-md](includes/appliesto-adf-xxx-md.md)] In this tutorial, you'll use the Data Factory user interface (UI) to create a pipeline that run activities and report lineage data to Microsoft Purview account. Then you can view all the lineage information in your Microsoft Purview account. Currently, lineage is supported for Copy, Data Flow, and Execute SSIS activities. Learn more details on the supported capabilities from [Supported Azure Data Factory activities](../purview/how-to-link-azure-data-factory.md#supported-azure-data-factory-activities). ## Prerequisites * **Azure subscription**. If you don't have an Azure subscription, create a [free Azure account](https://azure.microsoft.com/pricing/purchase-options/azure-account?cid=msft_learn) before you begin. * **Azure Data Factory**. If you don't have an Azure Data Factory, see [Create an Azure Data Factory](./quickstart-create-data-factory-portal.md). * **Microsoft Purview account**. The Microsoft Purview account captures all lineage data generated by data factory. If you don't have a Microsoft Purview account, see [Create a Microsoft Purview](../purview/create-catalog-portal.md). ## Run pipeline and push lineage data to Microsoft Purview ### Step 1: Connect Data Factory to your Microsoft Purview account You can establish the connection between Data Factory and Microsoft Purview account by following the steps in [Connect Data Factory to Microsoft Purview](connect-data-factory-to-azure-purview.md). ### Step 2: Run pipeline in Data Factory You can create pipelines, Copy activities and Dataflow activities in Data Factory. You don't need any additional configuration for lineage data capture. The lineage data will automatically be captured during the activities execution. :::image type="content" source="./media/data-factory-purview/adf-activities-for-lineage.png" alt-text="Screenshot of Copy and Dataflow activity."::: :::image type="content" source="./media/data-factory-purview/ssis-activities-for-lineage.png" alt-text="Screenshot of Execute SSIS Package activity."::: Learn more about how to create Copy, Data Flow and Execute SSIS activities from [Copy data from Azure Blob storage to a database in Azure SQL Database by using Azure Data Factory](./tutorial-copy-data-portal.md), [Transform data using mapping data flows](./tutorial-data-flow.md) and [Run SSIS Packages in Azure](./tutorial-deploy-ssis-packages-azure.md). ### Step 3: Monitor lineage reporting status After you run the pipeline, in the [pipeline monitoring view](monitor-visually.md#monitor-pipeline-runs), you can check the lineage reporting status by clicking the following **Lineage status** button. The same information is also available in the activity output JSON -> `reportLineageToPurvew` section. :::image type="content" source="./media/data-factory-purview/monitor-lineage-reporting-status.png" alt-text="Monitor the lineage reporting status in pipeline monitoring view."::: ### Step 4: View lineage information in your Microsoft Purview account On Microsoft Purview UI, you can browse assets and choose type "Azure Data Factory". You can also search the Data Catalog using keywords. :::image type="content" source="./media/data-factory-purview/view-dataset.png" alt-text="Screenshot of browsing assets in Microsoft Purview." lightbox="./media/data-factory-purview/view-dataset.png"::: On the activity asset, click the Lineage tab, you can see all the lineage information. - Copy activity: :::image type="content" source="./media/data-factory-purview/copy-lineage.png" alt-text="Screenshot of the Copy activity lineage in Microsoft Purview." lightbox="./media/data-factory-purview/copy-lineage.png"::: - Data Flow activity: :::image type="content" source="./media/data-factory-purview/dataflow-lineage.png" alt-text="Screenshot of the Data Flow lineage in Microsoft Purview." lightbox="./media/data-factory-purview/dataflow-lineage.png"::: > [!NOTE] > For the lineage of Dataflow activity, we only support source and sink. The lineage for Dataflow transformation is not supported yet. - Execute SSIS Package activity: :::image type="content" source="./media/data-factory-purview/ssis-lineage.png" alt-text="Screenshot of the Execute SSIS lineage in Microsoft Purview." lightbox="./media/data-factory-purview/ssis-lineage.png"::: > [!NOTE] > For the lineage of Execute SSIS Package activity, we only support source and destination. The lineage for transformation is not supported yet. ## Related content [Catalog lineage user guide](../purview/catalog-lineage-user-guide.md) [Connect Data Factory to Microsoft Purview](connect-data-factory-to-azure-purview.md)