Bias Analysis
Detected Bias Types
powershell_heavy
windows_tools
windows_first
missing_linux_example
Summary
The documentation provides both shell (Linux/Unix) and PowerShell (Windows) examples for uploading files and running jobs on HDInsight. However, PowerShell examples are more detailed, cover more scenarios (including error handling and job output retrieval), and are presented in full script form. There are multiple references to Windows-specific issues (e.g., CRLF line endings) and solutions using PowerShell. In troubleshooting, only PowerShell solutions are given for line ending problems, with no mention of Linux tools (e.g., dos2unix). The PowerShell workflow is described as the main remote submission method, and some limitations (e.g., inability to use C Python remotely) are only discussed in the PowerShell context. Windows tools and patterns (PowerShell, Azure modules) are mentioned before or more prominently than Linux equivalents.
Recommendations
- Provide equivalent Bash scripts for all PowerShell examples, including job submission, error retrieval, and file upload, using Azure CLI or REST API.
- Include troubleshooting steps for CRLF issues using Linux tools (e.g., dos2unix, sed) alongside PowerShell solutions.
- Clarify that both Linux and Windows environments are supported, and ensure that instructions for Linux users are as detailed and complete as those for Windows/PowerShell users.
- Mention Azure CLI as a cross-platform alternative to PowerShell for remote job submission and management.
- Where limitations exist (e.g., remote submission with C Python), explain if/how Linux users can work around them or provide parity.
- Balance the order of presentation so that Linux/Bash workflows are not secondary to Windows/PowerShell workflows.
Create Pull Request