dask 可视化（） KeyError

Question

我已经成功地可视化 dask 对象几天了，但我刚刚重新启动了我的 Jupyter 笔记本内核并遇到了我似乎无法调试的 KeyError。

在我重新启动内核之前，以下代码运行良好：

def sigmoid(x):
    '''Sigmoid function of x.'''
    return 1/(1+da.exp(-x))

X = da.from_array(np.random.random((4,2)), chunks=2)
beta = np.ones((2,1))

## 
p = (X.dot(beta)).map_blocks(sigmoid)
W = da.diag((p*(1-p))[:,0])
hessian = da.dot(X.T.dot(W),X)
hessian.visualize()

但现在当我运行时，我得到以下回溯：

KeyError                                  Traceback (most recent call last)
<ipython-input-62-660a47cb4654> in <module>()
      7 W = da.diag((p*(1-p))[:,0])
      8 hessian = dot(X.T.dot(W),X)
----> 9 hessian.visualize()

.../anaconda3/anaconda/lib/python3.5/site-packages/dask/base.py in visualize(self, filename, format, optimize_graph, **kwargs)
     59         """
     60         return visualize(self, filename=filename, format=format,
---> 61                          optimize_graph=optimize_graph, **kwargs)
     62 
     63     def compute(self, **kwargs):

.../anaconda3/anaconda/lib/python3.5/site-packages/dask/base.py in visualize(*args, **kwargs)
    234     dsk = merge(dsks)
    235 
--> 236     return dot_graph(dsk, filename=filename, **kwargs)
    237 
    238 

.../anaconda3/anaconda/lib/python3.5/site-packages/dask/dot.py in dot_graph(dsk, filename, format, **kwargs)
    217     dask.dot.to_graphviz
    218     """
--> 219     g = to_graphviz(dsk, **kwargs)
    220 
    221     fmts = ['.png', '.pdf', '.dot', '.svg', '.jpeg', '.jpg']

.../anaconda3/anaconda/lib/python3.5/site-packages/dask/dot.py in to_graphviz(dsk, data_attributes, function_attributes, rankdir, graph_attr, node_attr, edge_attr, **kwargs)
    130             if func_name not in seen:
    131                 seen.add(func_name)
--> 132                 g.node(func_name, label=task_label(v), shape='circle',
    133                        **function_attributes.get(k, {}))
    134             g.edge(func_name, k_name)

.../anaconda3/anaconda/lib/python3.5/site-packages/dask/dot.py in task_label(task)
     29     if hasattr(func, 'funcs'):
     30         if len(func.funcs) > 1:
---> 31             return '{0}(...)'.format(funcname(func.funcs[0]))
     32         else:
     33             head = funcname(func.funcs[0])

KeyError: 0

其中一项任务或类似的东西似乎缺少一些标签？

编辑：实际上，要重现错误，您需要修改 sigmoid 函数，如下所示：

from multipledispatch import dispatch

@dispatch(da.Array)
def sigmoid(x):
    '''Sigmoid function of x.'''
    return 1/(1+da.exp(-x))

@dispatch(np.ndarray)
def sigmoid(x):
    '''Sigmoid function of x.'''
    return 1/(1+np.exp(-x))

Answer 1

感谢您提供可重现的示例。

不幸的是，这对我来说运行良好：

In [1]: import numpy as np

In [2]: import dask.array as da

In [3]: from multipledispatch import dispatch
   ...: 
   ...: @dispatch(da.Array)
   ...: def sigmoid(x):
   ...:     '''Sigmoid function of x.'''
   ...:     return 1/(1+da.exp(-x))
   ...: 
   ...: @dispatch(np.ndarray)
   ...: def sigmoid(x):
   ...:     '''Sigmoid function of x.'''
   ...:     return 1/(1+np.exp(-x))
   ...: 

In [4]: pdb
Automatic pdb calling has been turned ON

In [5]: def sigmoid(x):
   ...:     '''Sigmoid function of x.'''
   ...:     return 1/(1+da.exp(-x))
   ...: 
   ...: X = da.from_array(np.random.random((4,2)), chunks=2)
   ...: beta = np.ones((2,1))
   ...: 
   ...: ## 
   ...: p = (X.dot(beta)).map_blocks(sigmoid)
   ...: W = da.diag((p*(1-p))[:,0])
   ...: hessian = da.dot(X.T.dot(W),X)
   ...: hessian.visualize()
   ...: 
Out[5]: <IPython.core.display.Image object>

在您重新启动某些东西之前它一直有效，这有点奇怪。也许您的环境有问题？