【问题标题】:detect circular dependencies in python检测python中的循环依赖
【发布时间】:2011-10-21 22:16:59
【问题描述】:

我不明白为什么DepsTree 类中的_ResolveDependencies 方法可以检测循环依赖。如果a需要beb需要e,它似乎可以检测到这种情况,但这不是循环依赖。

class DepsTree(object):
  """Represents the set of dependencies between source files."""

  def __init__(self, sources):
    """Initializes the tree with a set of sources.

    Args:
      sources: A set of JavaScript sources.

    Raises:
      MultipleProvideError: A namespace is provided by muplitple sources.
      NamespaceNotFoundError: A namespace is required but never provided.
    """

    self._sources = sources
    self._provides_map = dict()

    # Ensure nothing was provided twice.
    for source in sources:
      for provide in source.provides:
        if provide in self._provides_map:
          raise MultipleProvideError(
              provide, [self._provides_map[provide], source])

        self._provides_map[provide] = source

    # Check that all required namespaces are provided.
    for source in sources:
      for require in source.requires:
        if require not in self._provides_map:
          raise NamespaceNotFoundError(require, source)

  def GetDependencies(self, required_namespaces):
    """Get source dependencies, in order, for the given namespaces.

    Args:
      required_namespaces: A string (for one) or list (for one or more) of
        namespaces.

    Returns:
      A list of source objects that provide those namespaces and all
      requirements, in dependency order.

    Raises:
      NamespaceNotFoundError: A namespace is requested but doesn't exist.
      CircularDependencyError: A cycle is detected in the dependency tree.
    """
    if type(required_namespaces) is str:
      required_namespaces = [required_namespaces]

    deps_sources = []

    for namespace in required_namespaces:
      for source in DepsTree._ResolveDependencies(
          namespace, [], self._provides_map, []):
        if source not in deps_sources:
          deps_sources.append(source)

    return deps_sources

  @staticmethod
  def _ResolveDependencies(required_namespace, deps_list, provides_map,
                           traversal_path):
    """Resolve dependencies for Closure source files.

    Follows the dependency tree down and builds a list of sources in dependency
    order.  This function will recursively call itself to fill all dependencies
    below the requested namespaces, and then append its sources at the end of
    the list.

    Args:
      required_namespace: String of required namespace.
      deps_list: List of sources in dependency order.  This function will append
        the required source once all of its dependencies are satisfied.
      provides_map: Map from namespace to source that provides it.
      traversal_path: List of namespaces of our path from the root down the
        dependency/recursion tree.  Used to identify cyclical dependencies.
        This is a list used as a stack -- when the function is entered, the
        current namespace is pushed and popped right before returning.
        Each recursive call will check that the current namespace does not
        appear in the list, throwing a CircularDependencyError if it does.

    Returns:
      The given deps_list object filled with sources in dependency order.

    Raises:
      NamespaceNotFoundError: A namespace is requested but doesn't exist.
      CircularDependencyError: A cycle is detected in the dependency tree.
    """

    source = provides_map.get(required_namespace)
    if not source:
      raise NamespaceNotFoundError(required_namespace)

    if required_namespace in traversal_path:
      traversal_path.append(required_namespace)  # do this *after* the test

      # This must be a cycle.
      raise CircularDependencyError(traversal_path)

    traversal_path.append(required_namespace)

    for require in source.requires:

      # Append all other dependencies before we append our own.
      DepsTree._ResolveDependencies(require, deps_list, provides_map,
                                    traversal_path)
    deps_list.append(source)

    traversal_path.pop()

    return deps_list

【问题讨论】:

  • 不会检测到,它们是树上的独立分支。

标签: python circular-dependency google-closure-library


【解决方案1】:

短版:_ResolveDependencies 执行依赖树的深度优先遍历,记录路径。如果它遇到一个已经在路径中的节点,这意味着有一个循环。

_ResolveDependencies 遍历Source.requires 体现的依赖林。在任何时间点对_ResolveDependencies 的活动调用对应于通过依赖关系树的路径(因此traversal_path 中的_path);这是通过在递归之前向traversal_path 添加命名空间并在之后将其删除来跟踪的。换句话说,当且仅当_ResolveDependencies 的调用正在处理命名空间时,命名空间才在traversal_path 中。如果要求_ResolveDependencies 检查traversal_path 中已存在的命名空间,则对_ResolveDependencies 的不同调用正在处理该命名空间,并且存在从节点到自身的路径,因此存在循环。

例如,考虑最简单的依赖循环:“a”需要“c”需要“a”。让我们也加入一个“a”需要“b”来显示当分支中没有依赖项时会发生什么。您将获得以下调用序列(在伪 python 中)。大多数情况下,变量的值被替换为变量名(例如,a 替换为 ns.name)。注意:这不代表源代码,而是程序运行时执行的语句序列。

_RD(ns={name:a, req: [b, c]}, path=[]):
  如果在路径中:# false
  路径 += [a]
  对于 [b,c] 中的每个子节点:
    _RD(ns={name: b, req: []}, path=[a]):
      如果 b 在路径中:# false
      路径 += [b]
      对于 [] 中的每个子节点:
      # 完成这个分支
      路径-= [b]
    _RD(ns={name: c, req: [a]}, path=[a]):
      如果 c 在路径中:# false
      路径 += [c]
      对于 [a] 中的每个子节点:
        _RD(ns={name: a req: [b,c]}, path=[a, c]):
          如果在路径中:# true
            抛出 CircularDependencyError

【讨论】:

    猜你喜欢
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    • 2013-08-19
    • 1970-01-01
    • 2021-01-23
    • 1970-01-01
    • 1970-01-01
    • 1970-01-01
    相关资源
    最近更新 更多