【问题标题】:List of Azure Data Bricks clusters with useful info about cluster sizeAzure Data Bricks 群集列表,其中包含有关群集大小的有用信息
【发布时间】:2020-02-10 13:31:33
【问题描述】:

我想使用 PowerShell 列出 Azure 数据块集群清单以及与其相关的有用数据。有什么线索吗?

【问题讨论】:

    标签: azure powershell azure-powershell azure-databricks


    【解决方案1】:

    有可以在 Powershell 中使用的Databricks CLI,更具体地说是Clusters CLI

    它将允许您运行诸如

    之类的命令
    → ~/› databricks clusters list --output JSON 
    {
      "clusters": [
        {
          "cluster_id": "1234-567890-johns123",
          "driver": {
            "public_dns": "12.345.678.901",
            "node_id": "59cc30ad02c25bb7a8757e20d03bd621",
            "instance_id": "ab07b198eae4e82d9d4c4f85addaaf6c",
            "start_timestamp": 14641398417,
            "host_private_ip": "12.345.6.78",
            "private_ip": "01.234.5.67"
          }
          "spark_context_id": 132049817401283947123243,
          "jdbc_port": 10000,
          "cluster_name": "cluster-01",
          "spark_version": "5.5.x-cpu-ml-scala2.11",
          "node_type_id": "Standard_DS3_v2",
          "driver_node_type_id": "Standard_DS3_v2",
          "spark_env_vars": {
            "PYSPARK_PYTHON": "/databricks/python3/bin/python3"
          },
          "autotermination_minutes": 120,
          "enable_elastic_disk": true,
          "cluster_source": "UI",
          "state": "RUNNING",
          "state_message": "",
          "start_time": 17436797,
          "last_state_loss_time": 19158237,
          "autoscale": {
            "min_workers": 2,
            "max_workers": 4
          },
          "cluster_memory_mb": 129024,
          "cluster_cores": 36.0,
          "default_tags": {
            "Vendor": "Databricks",
            "Creator": "john@smith.com",
            "ClusterName": "cluster-01",
            "ClusterId": "1234-567890-johns123"
          },
          "creator_user_name":  "john@smith.com",
          "pinned_by_user_name": "1038471338747",
          "init_scripts_safe_mode": false
        }
    

    【讨论】:

      猜你喜欢
      • 2015-11-21
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2016-06-28
      • 2020-05-24
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      相关资源
      最近更新 更多