Document Details
Python Udf Hdinsight
This page contains Windows bias
About This Page
This page is part of the Azure documentation. It contains code examples and configuration instructions for working with Azure services.
Bias Analysis
Detected Bias Types
powershell_heavy
windows_tools
windows_first
missing_linux_example
Summary
The documentation page provides both shell (Linux/Unix) and PowerShell (Windows) examples for uploading files and running Hive/Pig jobs. However, there is a notable emphasis on PowerShell throughout, with extensive PowerShell scripts and troubleshooting steps. Windows-specific issues (CRLF line endings) and solutions are highlighted, while Linux equivalents (e.g., dos2unix) are not mentioned. PowerShell is presented as a primary remote management tool, and Linux alternatives (such as Azure CLI or Bash scripting) are not covered. The troubleshooting section focuses on Windows editor problems and PowerShell fixes, further reinforcing Windows bias.
Recommendations
- Add equivalent Azure CLI and Bash script examples for all PowerShell steps, including file upload and job submission.
- Include troubleshooting steps for Linux users, such as using 'dos2unix' to fix line endings.
- Mention and provide guidance for Linux-native tools (e.g., nano, vi, sed) for editing and preparing scripts.
- Balance the prominence of PowerShell and shell examples, ensuring Linux methods are presented first or equally.
- Clarify that HDInsight clusters are Linux-based and that most users will interact via SSH/bash, not PowerShell.
- Provide links to Linux/Unix documentation for remote management and scripting with Azure HDInsight.
Create Pull Request
Scan History
| Date | Scan | Status | Result |
|---|---|---|---|
| 2026-01-14 00:00 | #250 | in_progress |
Biased
|
| 2026-01-13 00:00 | #246 | completed |
Biased
|
| 2026-01-11 00:00 | #240 | completed |
Biased
|
| 2026-01-10 00:00 | #237 | completed |
Biased
|
| 2026-01-09 00:34 | #234 | completed |
Biased
|
| 2026-01-08 00:53 | #231 | completed |
Biased
|
| 2026-01-06 18:15 | #225 | cancelled |
 Clean
|
| 2025-08-17 00:01 | #83 | cancelled |
Clean
|
| 2025-07-13 21:37 | #48 | completed |
Clean
|
| 2025-07-12 23:44 | #41 | cancelled |
Biased
|