Document Details
Connector Hdfs
❌
This page contains Windows bias
About This Page
This page is part of the Azure documentation. It contains code examples and configuration instructions for working with Azure services.
Bias Analysis
Bias Types:
⚠️
windows_first
⚠️
powershell_heavy
⚠️
windows_tools
⚠️
missing_linux_example
Summary:
The documentation demonstrates a Windows-centric bias in several areas: authentication options and configuration steps are primarily described in terms of Windows authentication and Windows domain integration; configuration commands and tools (e.g., Ksetup, netdom) are Windows-specific and provided before or instead of Linux equivalents; and there are no explicit Linux-based integration runtime setup examples, even though HDFS and Kerberos are commonly used in Linux environments. The documentation assumes or prioritizes Windows environments for self-hosted integration runtime and Kerberos configuration, with only minimal references to Linux-native approaches.
Recommendations:
- Provide parallel Linux-based examples for self-hosted integration runtime setup, including Kerberos configuration using native Linux tools (e.g., kinit, krb5.conf, systemd services).
- Include Linux shell command equivalents for all Windows command-line instructions (e.g., Ksetup, netdom), or clarify if certain steps are only required on Windows.
- Explicitly document how to configure the integration runtime and HDFS connector on a Linux host, including any differences in authentication, file paths, or permissions.
- Balance the order of presentation so that Linux and Windows approaches are given equal prominence, or group them under clear OS-specific headings.
- Clarify which authentication types are supported on Linux, and provide guidance for common Linux-based HDFS/Kerberos deployments.
Create pull request
Scan History
| Date | Scan ID | Status | Bias Status |
|---|---|---|---|
| 2025-09-16 00:00 | #113 | completed | ✅ Clean |
| 2025-09-15 00:00 | #112 | completed | ✅ Clean |
| 2025-09-14 00:00 | #111 | completed | ✅ Clean |
| 2025-09-13 00:00 | #110 | completed | ✅ Clean |
| 2025-09-12 00:00 | #109 | completed | ✅ Clean |
| 2025-09-11 00:00 | #108 | completed | ✅ Clean |
| 2025-09-10 00:00 | #107 | completed | ✅ Clean |
| 2025-09-09 00:00 | #106 | completed | ✅ Clean |
| 2025-09-08 00:00 | #105 | completed | ✅ Clean |
| 2025-08-17 00:01 | #83 | in_progress | ✅ Clean |
| 2025-07-13 21:37 | #48 | completed | ❌ Biased |
| 2025-07-09 13:09 | #3 | cancelled | ✅ Clean |
| 2025-07-08 04:23 | #2 | cancelled | ❌ Biased |
Flagged Code Snippets
{
"name": "HDFSLinkedService",
"properties": {
"type": "Hdfs",
"typeProperties": {
"url" : "http://<machine>:50070/webhdfs/v1/",
"authenticationType": "Windows",
"userName": "<username>@<domain>.com (for Kerberos auth)",
"password": {
"type": "SecureString",
"value": "<password>"
}
},
"connectVia": {
"referenceName": "<name of Integration Runtime>",
"type": "IntegrationRuntimeReference"
}
}
}
C:> Ksetup /addkdc REALM.COM <your_kdc_server_address>
C:> ksetup /addhosttorealmmap HDFS-service-FQDN REALM.COM
C:> Ksetup /setdomain REALM.COM
C:> Ksetup /addkdc REALM.COM <your_kdc_server_address>
C:> Ksetup
default realm = REALM.COM (external)
REALM.com:
kdc = <your_kdc_server_address>
C:> netdom trust REALM.COM /Domain: AD.COM /add /realm /password:[password]
C:> ksetup /SetEncTypeAttr REALM.COM DES-CBC-CRC DES-CBC-MD5 RC4-HMAC-MD5 AES128-CTS-HMAC-SHA1-96 AES256-CTS-HMAC-SHA1-96
C:> Ksetup /addkdc REALM.COM <your_kdc_server_address>
C:> ksetup /addhosttorealmmap HDFS-service-FQDN REALM.COM