Document Details
Transform Data Using Hadoop Streaming
This page contains Windows bias
About This Page
This page is part of the Azure documentation. It contains code examples and configuration instructions for working with Azure services.
Bias Analysis
Detected Bias Types
windows_tools
missing_linux_example
Summary
The documentation page demonstrates bias toward Windows by exclusively using Windows-style executable names (e.g., MyMapper.exe, MyReducer.exe) in its JSON sample and file paths. There are no examples or mentions of Linux-style scripts (e.g., Python, Bash, or .sh files), which are commonly used in Hadoop Streaming jobs on Linux-based clusters. This may mislead users into thinking only Windows executables are supported or preferred, despite HDInsight and Hadoop Streaming being primarily Linux-based.
Recommendations
- Provide examples using Linux-compatible scripts, such as Python (.py), Bash (.sh), or other common Linux executables, in addition to or instead of Windows .exe files.
- Clarify in the documentation that both Windows and Linux executables/scripts are supported, and specify any platform limitations.
- Add a section or note explaining how users can prepare and upload Linux-based mapper and reducer scripts to Azure Storage for use in Hadoop Streaming activities.
- Ensure that sample file paths and command environment variables are platform-neutral or include both Windows and Linux variants.
Create Pull Request
Scan History
| Date | Scan | Status | Result |
|---|---|---|---|
| 2026-01-14 00:00 | #250 | in_progress |
Biased
|
| 2026-01-13 00:00 | #246 | completed |
Biased
|
| 2026-01-11 00:00 | #240 | completed |
Biased
|
| 2026-01-10 00:00 | #237 | completed |
Biased
|
| 2026-01-09 00:34 | #234 | completed |
Biased
|
| 2026-01-08 00:53 | #231 | completed |
Biased
|
| 2026-01-06 18:15 | #225 | cancelled |
 Clean
|
| 2025-08-17 00:01 | #83 | cancelled |
Clean
|
| 2025-07-13 21:37 | #48 | completed |
Biased
|
| 2025-07-09 13:09 | #3 | cancelled |
Clean
|
| 2025-07-08 04:23 | #2 | cancelled |
Biased
|