HDinsight 配置单元活动管道未在 Azure 数据湖中创建输出答案

【问题标题】：HDinsight hive activity pipeline not creating output in Azure data lakeHDinsight 配置单元活动管道未在 Azure 数据湖中创建输出
【发布时间】：2018-04-20 19:12:56
【问题描述】：

尝试使用数据工厂运行配置单元活动，管道完成正常，并在集群内创建包含数据的表，但输出数据集未在 Azure 数据湖存储中创建文件，这是故意的吗？

只是想学习，所以要温柔。

输入数据集：

包含数据的标准输入 csv 文件

{
"name": "dlsinput",
"properties": {
    "published": false,
    "type": "AzureDataLakeStore",
    "linkedServiceName": "dls",
    "typeProperties": {
        "fileName": "output.csv",
        "folderPath": "data/output/",
        "format": {
            "type": "TextFormat",
            "columnDelimiter": ","
        }
    },
    "availability": {
        "frequency": "Day",
        "interval": 1
    },
    "external": true,
    "policy": {}
}
}

管道：

引用 hdinsight 集群的管道

{
"name": "HiveActivitySamplePipeline",
"properties": {
    "activities": [
        {
            "type": "HDInsightHive",
            "typeProperties": {
                "scriptPath": "scripts/hive.hql",
                "scriptLinkedService": "sta"
            },
            "inputs": [
                {
                    "name": "dlsinput"
                }
            ],
            "outputs": [
                {
                    "name": "dlsoutput"
                }
            ],
            "scheduler": {
                "frequency": "Day",
                "interval": 1
            },
            "name": "HiveActivitySample",
            "linkedServiceName": "hdi"
        }
    ],
    "start": "2018-04-05T12:20:00Z",
    "end": "2018-04-10T23:59:59Z",
    "isPaused": false,
    "hubName": "adf",
    "pipelineMode": "Scheduled"
}
}

输出：

输出我想要创建的文件

{
"name": "dlsoutput",
"properties": {
    "published": false,
    "type": "AzureDataLakeStore",
    "linkedServiceName": "dls",
    "typeProperties": {
        "fileName": "myfile.csv",
        "folderPath": "data/output/",
        "format": {
            "type": "TextFormat",
            "rowDelimiter": "\n",
            "columnDelimiter": ","
        }
    },
    "availability": {
        "frequency": "Day",
        "interval": 1
    }
}
}

Hive.hql

DROP TABLE IF EXISTS temp;
CREATE EXTERNAL TABLE IF NOT EXISTS temp (
Name STRING,
Road STRING,
)
ROW FORMAT DELIMITED
FIELDS TERMINATED BY ','
STORED AS TEXTFILE
 LOCATION 'adl://dls.azuredatalakestore.net/data/output/';

【问题讨论】：

标签： azure-data-factory azure-hdinsight

【解决方案1】：

貌似是因为Hive.hql中只包含了创建表的命令，并没有向表中插入数据，所以你没有看到生成任何数据文件。

【讨论】：