Document Details

Apache Hadoop On Premises Migration Best Practices Infrastructure
Home / Scan #41 / Apache Hadoop On Premises Migration Best Practices Infrastructure
Sad Tux - Windows bias detected
This page contains Windows bias

About This Page

This page is part of the Azure documentation. It contains code examples and configuration instructions for working with Azure services.
GitHub View on GitHub 📚 View on Microsoft Learn

Bias Analysis

Detected Bias Types
powershell_heavy
windows_first
missing_linux_example
Summary
The documentation page demonstrates a Windows bias primarily in the 'Customize HDInsight configs using Bootstrap' section, where only a PowerShell (Windows-centric) example is provided for cluster configuration. There is no equivalent Bash/CLI or Linux-native example, despite HDInsight clusters being Linux-based by default. The PowerShell example is also presented before any mention of Linux-native tooling. Other sections reference Linux (e.g., edge nodes), but the only code sample is Windows-oriented, and there is a lack of parity in scripting guidance for Linux users.
Recommendations
  • Provide equivalent Bash/Azure CLI examples alongside PowerShell for all cluster configuration tasks, especially in the 'Customize HDInsight configs using Bootstrap' section.
  • Explicitly mention that HDInsight clusters are Linux-based by default and highlight Linux-native management options (e.g., Azure CLI, Bash scripting, REST API) before or alongside Windows/PowerShell options.
  • Ensure that all code samples and automation guidance are available for both Windows and Linux users to avoid platform bias.
  • Where PowerShell is referenced, add a note or link to corresponding Linux/CLI documentation.
  • Review other sections for subtle prioritization of Windows tools or terminology and ensure Linux parity throughout.
GitHub Create Pull Request

Scan History

Date Scan Status Result
2026-01-14 00:00 #250 in_progress Biased Biased
2026-01-13 00:00 #246 completed Biased Biased
2026-01-11 00:00 #240 completed Biased Biased
2026-01-10 00:00 #237 completed Biased Biased
2026-01-09 00:34 #234 completed Biased Biased
2026-01-08 00:53 #231 completed Biased Biased
2026-01-06 18:15 #225 cancelled Clean Clean
2025-08-17 00:01 #83 cancelled Clean Clean
2025-07-13 21:37 #48 completed Clean Clean
2025-07-12 23:44 #41 cancelled Biased Biased

Flagged Code Snippets

# hive-site.xml configuration
$hiveConfigValues = @{"hive.metastore.client.socket.timeout"="90"}

$config = New—AzHDInsightClusterConfig '
    | Set—AzHDInsightDefaultStorage
    —StorageAccountName "$defaultStorageAccountName.blob. core.windows.net" `
    —StorageAccountKey "defaultStorageAccountKey " `
    | Add—AzHDInsightConfigValues `
        —HiveSite $hiveConfigValues

New—AzHDInsightCluster `
    —ResourceGroupName $existingResourceGroupName `
    —Cluster-Name $clusterName `
    —Location $location `
    —ClusterSizeInNodes $clusterSizeInNodes `
    —ClusterType Hadoop `
    —OSType Linux `
    —Version "3.6" `
    —HttpCredential $httpCredential `
    —Config $config