Document Details
Transform Data Using Hadoop Streaming
This page contains Windows bias
About This Page
This page is part of the Azure documentation. It contains code examples and configuration instructions for working with Azure services.
Bias Analysis
Detected Bias Types
windows_tools
missing_linux_example
Summary
The documentation page exhibits Windows bias by using Windows-style executable names (e.g., MyMapper.exe, MyReducer.exe) in its JSON sample and file paths, without providing equivalent Linux examples (such as Python scripts or shell scripts). There is no mention of Linux-compatible formats or guidance for users who may want to use non-Windows executables, which is a common scenario in Hadoop Streaming on Linux-based clusters.
Recommendations
- Provide examples using Linux-compatible mapper and reducer scripts (e.g., MyMapper.py, MyReducer.sh) alongside the Windows .exe examples.
- Clarify that both Windows and Linux executables/scripts are supported, and specify any platform-specific requirements or limitations.
- Add guidance on how to prepare and upload Linux-based scripts to Azure Storage for use in HDInsight Streaming activities.
- Include notes or examples for common open-source languages used in Hadoop Streaming (e.g., Python, Perl, Bash) to improve parity for Linux users.
Create Pull Request
Scan History
| Date | Scan | Status | Result |
|---|---|---|---|
| 2026-01-14 00:00 | #250 | in_progress |
Biased
|
| 2026-01-13 00:00 | #246 | completed |
Biased
|
| 2026-01-11 00:00 | #240 | completed |
Biased
|
| 2026-01-10 00:00 | #237 | completed |
Biased
|
| 2026-01-09 00:34 | #234 | completed |
Biased
|
| 2026-01-08 00:53 | #231 | completed |
Biased
|
| 2026-01-06 18:15 | #225 | cancelled |
 Clean
|
| 2025-08-17 00:01 | #83 | cancelled |
Clean
|
| 2025-07-13 21:37 | #48 | completed |
Biased
|
| 2025-07-09 13:09 | #3 | cancelled |
Clean
|
| 2025-07-08 04:23 | #2 | cancelled |
Biased
|