Document Details
Apache Hadoop Hive Pig Udf Dotnet Csharp
❌
This page contains Windows bias
About This Page
This page is part of the Azure documentation. It contains code examples and configuration instructions for working with Azure services.
Bias Analysis
Bias Types:
⚠️
windows_first
⚠️
powershell_heavy
⚠️
missing_linux_example
Summary:
The documentation demonstrates a Windows/Visual Studio-centric workflow, with all project creation, building, uploading, and job submission steps described using Visual Studio and Azure tools that are primarily Windows-based. While there is a brief mention of SSH for Pig jobs, there are no Linux-native or cross-platform alternatives for building, uploading, or running jobs, and no command-line or non-Visual Studio workflows are provided. Linux is only referenced as the HDInsight cluster OS, not as a development or client environment.
Recommendations:
- Provide equivalent instructions for creating, building, and packaging the C# UDFs using cross-platform tools such as the dotnet CLI and MonoDevelop, which are available on Linux and macOS.
- Include examples of uploading .exe files to HDInsight storage using Azure CLI and/or azcopy, with command-line instructions suitable for Linux/macOS.
- Demonstrate how to submit Hive queries and Pig jobs using Azure CLI, SSH, or other cross-platform methods, not just through Visual Studio.
- Reorder or parallelize instructions so that Windows/Visual Studio and Linux/cross-platform workflows are presented equally, or at least mention Linux alternatives alongside Windows steps.
- Explicitly state that all steps can be performed from Linux/macOS, and provide guidance for users who do not have access to Visual Studio or Windows.
Create pull request
Scan History
| Date | Scan ID | Status | Bias Status |
|---|---|---|---|
| 2025-08-17 00:01 | #83 | in_progress | ✅ Clean |
| 2025-07-13 21:37 | #48 | completed | ❌ Biased |
| 2025-07-12 23:44 | #41 | in_progress | ❌ Biased |
Flagged Code Snippets
-- Uncomment the following if you are using Azure Storage
-- add file wasbs:///HiveCSharp.exe;
-- Uncomment the following if you are using Azure Data Lake Storage Gen1
-- add file adl:///HiveCSharp.exe;
-- Uncomment the following if you are using Azure Data Lake Storage Gen2
-- add file abfs:///HiveCSharp.exe;
SELECT TRANSFORM (clientid, devicemake, devicemodel)
USING 'HiveCSharp.exe' AS
(clientid string, phoneLabel string, phoneHash string)
FROM hivesampletable
ORDER BY clientid LIMIT 50;