Hdinsight Storage Sharedaccesssignature Permissions

Bias Analysis

Bias Types:

⚠️ powershell_heavy

⚠️ windows_first

⚠️ windows_tools

⚠️ missing_linux_example

Summary:

The documentation demonstrates a Windows bias by providing detailed PowerShell and Windows Command Prompt examples first, using Windows-specific environment variable syntax in Azure CLI sections, and referencing Visual Studio and Windows-centric workflows. There is a lack of parity for Linux/bash users, especially in the Azure CLI section, which only shows Windows-style commands and does not provide bash equivalents. PowerShell is the primary scripting language throughout, and Linux-native tools or patterns are not equally represented.

Recommendations:

Provide bash/Linux equivalents for all Azure CLI examples, using export for environment variables and bash syntax.
Add explicit bash examples alongside PowerShell for all scripting steps, especially for cluster creation and SAS configuration.
Clarify in each section whether the example is for Windows or Linux, and ensure both are covered.
Include instructions for using cross-platform editors and tools, not just Visual Studio (e.g., VS Code, JetBrains Rider, etc.).
Where PowerShell is used, offer bash or shell script alternatives for Linux users.
Review all code snippets and ensure that Linux users can follow the guide without needing to translate Windows-specific commands.

Create pull request

Date	Scan ID	Status	Bias Status
2025-09-06 00:00	#103	completed	✅ Clean
2025-08-17 00:01	#83	in_progress	✅ Clean
2025-07-13 21:37	#48	completed	✅ Clean
2025-07-12 23:44	#41	in_progress	❌ Biased
2025-07-09 13:09	#3	cancelled	✅ Clean
2025-07-08 04:23	#2	cancelled	❌ Biased

Flagged Code Snippets

# set variables set AZURE_STORAGE_ACCOUNT=STORAGEACCOUNT set AZURE_STORAGE_CONTAINER=STORAGECONTAINER #Login az login # If you have multiple subscriptions, set the one to use # az account set --subscription SUBSCRIPTION # Retrieve the primary key for the storage account az storage account keys list --account-name %AZURE_STORAGE_ACCOUNT% --query "[0].{PrimaryKey:value}" --output table

#set variable for primary key set AZURE_STORAGE_KEY=PRIMARYKEY

$clusterName = 'CLUSTERNAME' $resourceGroupName = 'RESOURCEGROUP' # Replace with the Azure data center you want to the cluster to live in $location = 'eastus' # Replace with the name of the default storage account TO BE CREATED $defaultStorageAccountName = 'DEFAULTSTORAGEACCOUNT' # Replace with the name of the SAS container CREATED EARLIER $SASContainerName = 'STORAGECONTAINER' # Replace with the name of the SAS storage account CREATED EARLIER $SASStorageAccountName = 'STORAGEACCOUNT' # Replace with the SAS token generated earlier $SASToken = 'TOKEN' # Default cluster size (# of worker nodes), version, and type $clusterSizeInNodes = "4" $clusterVersion = "3.6" $clusterType = "Hadoop" # Login to your Azure subscription $sub = Get-AzSubscription -ErrorAction SilentlyContinue if(-not($sub)) { Connect-AzAccount } # If you have multiple subscriptions, set the one to use # Select-AzSubscription -SubscriptionId "<SUBSCRIPTIONID>" # Create an Azure Storage account and container New-AzStorageAccount ` -ResourceGroupName $resourceGroupName ` -Name $defaultStorageAccountName ` -Location $location ` -SkuName Standard_LRS ` -Kind StorageV2 ` -EnableHttpsTrafficOnly 1 $defaultStorageAccountKey = (Get-AzStorageAccountKey ` -ResourceGroupName $resourceGroupName ` -Name $defaultStorageAccountName)[0].Value $defaultStorageContext = New-AzStorageContext ` -StorageAccountName $defaultStorageAccountName ` -StorageAccountKey $defaultStorageAccountKey # Create a blob container. This holds the default data store for the cluster. New-AzStorageContainer ` -Name $clusterName ` -Context $defaultStorageContext # Cluster login is used to secure HTTPS services hosted on the cluster $httpCredential = Get-Credential ` -Message "Enter Cluster login credentials" ` -UserName "admin" # SSH user is used to remotely connect to the cluster using SSH clients $sshCredential = Get-Credential ` -Message "Enter SSH user credentials" ` -UserName "sshuser" # Create the configuration for the cluster $config = New-AzHDInsightClusterConfig $config = $config | Add-AzHDInsightConfigValue ` -Spark2Defaults @{} ` -Core @{"fs.azure.sas.$SASContainerName.$SASStorageAccountName.blob.core.windows.net"=$SASToken} # Create the HDInsight cluster New-AzHDInsightCluster ` -Config $config ` -ResourceGroupName $resourceGroupName ` -ClusterName $clusterName ` -Location $location ` -ClusterSizeInNodes $clusterSizeInNodes ` -ClusterType $clusterType ` -OSType Linux ` -Version $clusterVersion ` -HttpCredential $httpCredential ` -SshCredential $sshCredential ` -DefaultStorageAccountName "$defaultStorageAccountName.blob.core.windows.net" ` -DefaultStorageAccountKey $defaultStorageAccountKey ` -DefaultStorageContainer $clusterName <# REVERSAL Remove-AzHDInsightCluster ` -ResourceGroupName $resourceGroupName ` -ClusterName $clusterName Remove-AzStorageContainer ` -Name $clusterName ` -Context $defaultStorageContext Remove-AzStorageAccount ` -ResourceGroupName $resourceGroupName ` -Name $defaultStorageAccountName Remove-AzResourceGroup ` -Name $resourceGroupName #>

$resourceGroupName = "RESOURCEGROUP" $storageAccountName = "STORAGEACCOUNT" $containerName = "STORAGECONTAINER" $policy = "myPolicyPS" # Login to your Azure subscription $sub = Get-AzSubscription -ErrorAction SilentlyContinue if(-not($sub)) { Connect-AzAccount } # If you have multiple subscriptions, set the one to use # Select-AzSubscription -SubscriptionId "<SUBSCRIPTIONID>" # Get the access key for the Azure Storage account $storageAccountKey = (Get-AzStorageAccountKey ` -ResourceGroupName $resourceGroupName ` -Name $storageAccountName)[0].Value # Create an Azure Storage context $storageContext = New-AzStorageContext ` -StorageAccountName $storageAccountName ` -StorageAccountKey $storageAccountKey # Create a stored access policy for the Azure storage container New-AzStorageContainerStoredAccessPolicy ` -Container $containerName ` -Policy $policy ` -Permission "rl" ` -ExpiryTime "12/31/2025 08:00:00" ` -Context $storageContext # Get the stored access policy or policies for the Azure storage container Get-AzStorageContainerStoredAccessPolicy ` -Container $containerName ` -Context $storageContext # Generates an SAS token for the Azure storage container New-AzStorageContainerSASToken ` -Name $containerName ` -Policy $policy ` -Context $storageContext <# Removes a stored access policy from the Azure storage container Remove-AzStorageContainerStoredAccessPolicy ` -Container $containerName ` -Policy $policy ` -Context $storageContext #> # upload a file for a later example Set-AzStorageblobcontent ` -File "./sampledata/sample.log" ` -Container $containerName ` -Blob "samplePS.log" ` -Context $storageContext

# Create stored access policy on the containing object az storage container policy create --container-name %AZURE_STORAGE_CONTAINER% --name myPolicyCLI --account-key %AZURE_STORAGE_KEY% --account-name %AZURE_STORAGE_ACCOUNT% --expiry 2025-12-31 --permissions rl # List stored access policies on a containing object az storage container policy list --container-name %AZURE_STORAGE_CONTAINER% --account-key %AZURE_STORAGE_KEY% --account-name %AZURE_STORAGE_ACCOUNT% # Generate a shared access signature for the container az storage container generate-sas --name %AZURE_STORAGE_CONTAINER% --policy-name myPolicyCLI --account-key %AZURE_STORAGE_KEY% --account-name %AZURE_STORAGE_ACCOUNT% # Reversal # az storage container policy delete --container-name %AZURE_STORAGE_CONTAINER% --name myPolicyCLI --account-key %AZURE_STORAGE_KEY% --account-name %AZURE_STORAGE_ACCOUNT% # upload a file for a later example az storage blob upload --container-name %AZURE_STORAGE_CONTAINER% --account-key %AZURE_STORAGE_KEY% --account-name %AZURE_STORAGE_ACCOUNT% --name sampleCLI.log --file "./sampledata/sample.log"

Document Details

About This Page

Bias Analysis

Scan History

Flagged Code Snippets