Document Details
Hdinsight Sales Insights Etl
❌
This page contains Windows bias
About This Page
This page is part of the Azure documentation. It contains code examples and configuration instructions for working with Azure services.
Bias Analysis
Bias Types:
⚠️
powershell_heavy
⚠️
windows_first
⚠️
windows_tools
Summary:
The documentation demonstrates a moderate Windows bias, particularly in the section on triggering the Data Factory pipeline, where PowerShell is presented as the primary scripted method, with no equivalent Bash/Azure CLI example for Linux users. Power BI Desktop, a Windows-only tool, is the only visualization option described, and its use is assumed throughout. The documentation refers to Windows tools and patterns (PowerShell, Power BI Desktop) before or instead of cross-platform or Linux-native alternatives.
Recommendations:
- Provide an Azure CLI or Bash example for triggering and monitoring the Data Factory pipeline, ensuring Linux users have a first-class scripted option.
- Explicitly mention that Power BI Desktop is Windows-only and suggest alternatives for Linux users, such as Power BI web, Azure Data Studio, or open-source BI tools.
- When presenting multiple options (e.g., scripting vs. portal), avoid listing Windows/PowerShell options first by default; consider parallel presentation or alternating order.
- Include notes or links to documentation for connecting to HDInsight from Linux or macOS environments, especially for visualization and data access.
- Audit for other sections where only Windows tools or workflows are described, and add Linux/macOS equivalents where possible.
Create pull request
Scan History
| Date | Scan ID | Status | Bias Status |
|---|---|---|---|
| 2025-08-17 00:01 | #83 | in_progress | ✅ Clean |
| 2025-07-13 21:37 | #48 | completed | ❌ Biased |
| 2025-07-12 23:44 | #41 | in_progress | ❌ Biased |
| 2025-07-09 13:09 | #3 | cancelled | ✅ Clean |
| 2025-07-08 04:23 | #2 | cancelled | ❌ Biased |
Flagged Code Snippets
Re-execute `Get-AzDataFactoryV2PipelineRun` as needed to monitor progress.
Or you can:
* Open the data factory and select **Author & Monitor**. Trigger the `IngestAndTransform` pipeline from the portal. For information on how to trigger pipelines through the portal, see [Create on-demand Apache Hadoop clusters in HDInsight by using Azure Data Factory](hdinsight-hadoop-create-linux-clusters-adf.md#trigger-a-pipeline).
To verify that the pipeline has run, take one of the following steps:
* Go to the **Monitor** section in your data factory through the portal.
* In Azure Storage Explorer, go to your Data Lake Storage Gen2 storage account. Go to the `files` file system, and then go to the `transformed` folder. Check the folder contents to see if the pipeline succeeded.
For other ways to transform data by using HDInsight, see [this article on using Jupyter Notebook](/azure/hdinsight/spark/apache-spark-load-data-run-query).
### Create a table on the Interactive Query cluster to view data on Power BI
1. Copy the `query.hql` file to the LLAP cluster by using the secure copy (SCP) command. Enter the command: