Connector Hdfs - Document Details

About This Page

This page is part of the Azure documentation. It contains code examples and configuration instructions for working with Azure services.

View on GitHub 📚 View on Microsoft Learn

Bias Analysis

Detected Bias Types

windows_first

powershell_heavy

windows_tools

missing_linux_example

Summary

The documentation demonstrates a Windows-centric bias in several areas: authentication options and configuration steps are primarily described in terms of Windows authentication and Windows domain integration; configuration commands and tools (e.g., Ksetup, netdom) are Windows-specific and provided before or instead of Linux equivalents; and there are no explicit Linux-based integration runtime setup examples, even though HDFS and Kerberos are commonly used in Linux environments. The documentation assumes or prioritizes Windows environments for self-hosted integration runtime and Kerberos configuration, with only minimal references to Linux-native approaches.

Recommendations

Provide parallel Linux-based examples for self-hosted integration runtime setup, including Kerberos configuration using native Linux tools (e.g., kinit, krb5.conf, systemd services).
Include Linux shell command equivalents for all Windows command-line instructions (e.g., Ksetup, netdom), or clarify if certain steps are only required on Windows.
Explicitly document how to configure the integration runtime and HDFS connector on a Linux host, including any differences in authentication, file paths, or permissions.
Balance the order of presentation so that Linux and Windows approaches are given equal prominence, or group them under clear OS-specific headings.
Clarify which authentication types are supported on Linux, and provide guidance for common Linux-based HDFS/Kerberos deployments.

Create Pull Request

Scan History

Date	Scan	Status	Result
2026-01-14 00:00	#250	in_progress	Clean
2026-01-13 00:00	#246	completed	Clean
2026-01-11 00:00	#240	completed	Clean
2026-01-10 00:00	#237	completed	Clean
2026-01-09 00:34	#234	completed	Clean
2026-01-08 00:53	#231	completed	Clean
2026-01-06 18:15	#225	cancelled	Clean
2025-09-16 00:00	#113	completed	Clean
2025-09-15 00:00	#112	completed	Clean
2025-09-14 00:00	#111	completed	Clean
2025-09-13 00:00	#110	completed	Clean
2025-09-12 00:00	#109	completed	Clean
2025-09-11 00:00	#108	completed	Clean
2025-09-10 00:00	#107	completed	Clean
2025-09-09 00:00	#106	completed	Clean
2025-09-08 00:00	#105	completed	Clean
2025-08-17 00:01	#83	cancelled	Clean
2025-07-13 21:37	#48	completed	Biased
2025-07-09 13:09	#3	cancelled	Clean
2025-07-08 04:23	#2	cancelled	Biased

Flagged Code Snippets

{
    "name": "HDFSLinkedService",
    "properties": {
        "type": "Hdfs",
        "typeProperties": {
            "url" : "http://<machine>:50070/webhdfs/v1/",
            "authenticationType": "Windows",
            "userName": "<username>@<domain>.com (for Kerberos auth)",
            "password": {
                "type": "SecureString",
                "value": "<password>"
            }
        },
        "connectVia": {
            "referenceName": "<name of Integration Runtime>",
            "type": "IntegrationRuntimeReference"
        }
    }
}

    C:> Ksetup /addkdc REALM.COM <your_kdc_server_address>
    C:> ksetup /addhosttorealmmap HDFS-service-FQDN REALM.COM

    C:> Ksetup /setdomain REALM.COM
    C:> Ksetup /addkdc REALM.COM <your_kdc_server_address>

    C:> Ksetup
    default realm = REALM.COM (external)
    REALM.com:
        kdc = <your_kdc_server_address>

    C:> netdom trust REALM.COM /Domain: AD.COM /add /realm /password:[password]

    C:> ksetup /SetEncTypeAttr REALM.COM DES-CBC-CRC DES-CBC-MD5 RC4-HMAC-MD5 AES128-CTS-HMAC-SHA1-96 AES256-CTS-HMAC-SHA1-96

   C:> Ksetup /addkdc REALM.COM <your_kdc_server_address>
   C:> ksetup /addhosttorealmmap HDFS-service-FQDN REALM.COM