Proposed Pull Request Change

📄 Document Links

View on GitHub View on Microsoft Learn

--- title: Repairing an Azure Import/Export export job - v1 | Microsoft Docs description: Learn how to repair an export job that was created and run using the Azure Import/Export service. author: stevenmatthew services: storage ms.service: azure-import-export ms.topic: how-to ms.date: 03/14/2022 ms.author: shaas # Customer intent: "As a data engineer, I want to repair an Azure export job using the Import/Export Tool, so that I can ensure all files are successfully exported and validate the integrity of the data transferred to Azure storage." --- # Repairing an export job > [!IMPORTANT] > Job repair is no longer supported by the Azure Import/Export tool. In version 1.5.0.300 and later, you'll need to fix the issues in your blob export and then [create a new export job](storage-import-export-data-from-blobs.md?tabs=azure-portal#step-1-create-an-export-job). After an export job has completed, you can run the Microsoft Azure Import/Export Tool on-premises to: 1. Download any files that the Azure Import/Export service was unable to export. 2. Validate that the files on the drive were correctly exported. You must have connectivity to Azure Storage to use this functionality. The command for repairing an import job is **RepairExport**. ## RepairExport parameters The following parameters can be specified with **RepairExport**: |Parameter|Description| |---------------|-----------------| |**/r:<RepairFile\>**|Required. Path to the repair file, which tracks the progress of the repair, and allows you to resume an interrupted repair. Each drive must have one and only one repair file. When you start a repair for a given drive, you pass the path to a repair file, which doesn't yet exist. To resume an interrupted repair, you should pass in the name of an existing repair file. Always specify the repair file corresponding to the target drive.| |**/logdir:<LogDirectory\>**|Optional. The log directory. Verbose log files will be written to this directory. If no log directory is specified, the current directory will be used as the log directory.| |**/d:<TargetDirectory\>**|Required. The directory to validate and repair. This directory is usually the root directory of the export drive, but could also be a network file share containing a copy of the exported files.| |**/bk:<BitLockerKey\>**|Optional. Specify the BitLocker key if you want the tool to unlock an encrypted where the exported files are stored.| |**/sn:<StorageAccountName\>**|Required. The name of the storage account for the export job.| |**/sk:<StorageAccountKey\>**|**Required** if and only if a container SAS isn't specified. The account key for the storage account for the export job.| |**/csas:<ContainerSas\>**|**Required** if and only if the storage account key isn't specified. The container SAS for accessing the blobs associated with the export job.| |**/CopyLogFile:<DriveCopyLogFile\>**|Required. The path to the drive copy log file. The file is generated by the Windows Azure Import/Export service and can be downloaded from the blob storage associated with the job. The copy log file contains information about failed blobs or files that are to be repaired.| |**/ManifestFile:<DriveManifestFile\>**|Optional. The path to the export drive's manifest file. This file is generated by the Windows Azure Import/Export service and stored on the export drive. Optionally, in a blob in the storage account associated with the job.<br /><br /> The content of the files on the export drive will be verified with the MD5 hashes contained in this file. Any corrupted files will be downloaded and rewritten to the target directories.| ## Using RepairExport mode to correct failed exports You can use the Azure Import/Export Tool to download files that failed to export. The copy log file will contain a list of files that failed to export. The causes of export failures include the following possibilities: - Damaged drives - The storage account key changed during the transfer process To run the tool in **RepairExport** mode, you first need to connect the drive containing the exported files to your computer. Next, run the Azure Import/Export Tool, specifying the path to that drive with the `/d` parameter. You also need to specify the path to the drive's copy log file that you downloaded. The following command-line example below runs the tool to repair any files that failed to export: ``` WAImportExport.exe RepairExport /r:C:\WAImportExport\9WM35C3U.rep /d:G:\ /sn:bobmediaaccount /sk:VkGbrUqBWLYJ6zg1m29VOTrxpBgdNOlp+kp0C9MEdx3GELxmBw4hK94f7KysbbeKLDksg7VoN1W/a5UuM2zNgQ== /CopyLogFile:C:\WAImportExport\9WM35C3U.log ``` The following example is a copy log file that shows that one block in the blob failed to export: ```xml <?xml version="1.0" encoding="utf-8"?> <DriveLog> <DriveId>9WM35C2V</DriveId> <Blob Status="CompletedWithErrors"> <BlobPath>pictures/wild/desert.jpg</BlobPath> <FilePath>\pictures\wild\desert.jpg</FilePath> <LastModified>2012-09-18T23:47:08Z</LastModified> <Length>163840</Length> <BlockList> <Block Offset="65536" Length="65536" Id="AQAAAA==" Status="Failed" /> </BlockList> </Blob> <Status>CompletedWithErrors</Status> </DriveLog> ``` The copy log file indicates that a failure occurred while the Windows Azure Import/Export service was downloading one of the blob's blocks to the file on the export drive. The other components of the file downloaded successfully, and the file length was correctly set. In this case, the tool will open the file on the drive, download the block from the storage account, and write it to the file range starting from offset 65536 with length 65536. ## Using RepairExport to validate drive contents You can also use Azure Import/Export with the **RepairExport** option to validate the contents on the drive are correct. The manifest file on each export drive contains MD5s for the contents of the drive. The Azure Import/Export service can also save the manifest files to a storage account during the export process. The location of the manifest files is available via the [Get Job](/rest/api/storageimportexport/jobs) operation when the job has completed. For more information about the format of a drive manifest file, see [Import/Export service Manifest File Format](/previous-versions/azure/storage/common/storage-import-export-file-format-metadata-and-properties). The following example shows how to run the Azure Import/Export Tool with the **/ManifestFile** and **/CopyLogFile** parameters: ``` WAImportExport.exe RepairExport /r:C:\WAImportExport\9WM35C3U.rep /d:G:\ /sn:bobmediaaccount /sk:VkGbrUqBWLYJ6zg1m29VOTrxpBgdNOlp+kp0C9MEdx3GELxmBw4hK94f7KysbbeKLDksg7VoN1W/a5UuM2zNgQ== /CopyLogFile:C:\WAImportExport\9WM35C3U.log /ManifestFile:G:\9WM35C3U.manifest ``` The following example shows a manifest file: ```xml <?xml version="1.0" encoding="utf-8"?> <DriveManifest Version="2011-10-01"> <Drive> <DriveId>9WM35C3U</DriveId> <ClientCreator>Windows Azure Import/Export service</ClientCreator> <BlobList> <Blob> <BlobPath>pictures/city/redmond.jpg</BlobPath> <FilePath>\pictures\city\redmond.jpg</FilePath> <Length>15360</Length> <PageRangeList> <PageRange Offset="0" Length="3584" Hash="72FC55ED9AFDD40A0C8D5C4193208416" /> <PageRange Offset="3584" Length="3584" Hash="68B28A561B73D1DA769D4C24AA427DB8" /> <PageRange Offset="7168" Length="512" Hash="F521DF2F50C46BC5F9EA9FB787A23EED" /> </PageRangeList> <PropertiesPath Hash="E72A22EA959566066AD89E3B49020C0A">\pictures\city\redmond.jpg.properties</PropertiesPath> </Blob> <Blob> <BlobPath>pictures/wild/canyon.jpg</BlobPath> <FilePath>\pictures\wild\canyon.jpg</FilePath> <Length>10884</Length> <BlockList> <Block Offset="0" Length="2721" Id="AAAAAA==" Hash="263DC9C4B99C2177769C5EBE04787037" /> <Block Offset="2721" Length="2721" Id="AQAAAA==" Hash="0C52BAE2CC20EFEC15CC1E3045517AA6" /> <Block Offset="5442" Length="2721" Id="AgAAAA==" Hash="73D1CB62CB426230C34C9F57B7148F10" /> <Block Offset="8163" Length="2721" Id="AwAAAA==" Hash="11210E665C5F8E7E4F136D053B243E6A" /> </BlockList> <PropertiesPath Hash="81D7F81B2C29F10D6E123D386C3A4D5A">\pictures\wild\canyon.jpg.properties</PropertiesPath> </Blob> </BlobList> </Drive> </DriveManifest> ``` After finishing the repair process, the tool will read through each file referenced in the manifest file and verify the file's integrity with the MD5 hashes. For the manifest above, it will go through the following components. ``` G:\pictures\city\redmond.jpg, offset 0, length 3584 G:\pictures\city\redmond.jpg, offset 3584, length 3584 G:\pictures\city\redmond.jpg, offset 7168, length 3584 G:\pictures\city\redmond.jpg.properties G:\pictures\wild\canyon.jpg, offset 0, length 2721 G:\pictures\wild\canyon.jpg, offset 2721, length 2721 G:\pictures\wild\canyon.jpg, offset 5442, length 2721 G:\pictures\wild\canyon.jpg, offset 8163, length 2721 G:\pictures\wild\canyon.jpg.properties ``` Any component failing the verification will be downloaded by the tool and rewritten to the same file on the drive. ## Next steps <!--* [Setting Up the Azure Import/Export Tool](storage-import-export-tool-setup-v1.md)--> * [Preparing hard drives for an import job](storage-import-export-data-to-blobs.md#step-1-prepare-the-drives) * [Reviewing job status with copy log files](storage-import-export-tool-reviewing-job-status-v1.md) <!--* [Repairing an import job](storage-import-export-tool-repairing-an-import-job-v1.md)-->