【发布时间】:2019-08-08 08:09:54
【问题描述】:
我想在执行期间激活或停用某个类方法中的“缓存”。
我找到了一种方法来激活它:
(...)
setattr(self, "_greedy_function", my_cache_decorator(self._cache)(getattr(self, "_greedy_function")))
(...)
其中self._cache 是我自己的一个缓存对象,用于存储self._greedy_function 的结果。
它工作正常,但现在如果我想停用缓存并“取消装饰”_greedy_function,该怎么办?
我看到了一个可能的解决方案,在装饰之前存储 _greedy_function 的引用,但也许有一种方法可以从装饰函数中检索它,这样会更好。
根据要求,这里是我用来缓存类函数结果的装饰器和缓存对象:
import logging
from collections import OrderedDict, namedtuple
from functools import wraps
logging.basicConfig(
level=logging.WARNING,
format='%(asctime)s %(name)s %(levelname)s %(message)s'
)
logger = logging.getLogger(__name__)
logger.setLevel(logging.INFO)
CacheInfo = namedtuple("CacheInfo", "hits misses maxsize currsize")
def lru_cache(cache):
"""
A replacement for functools.lru_cache() build on a custom LRU Class.
It can cache class methods.
"""
def decorator(func):
logger.debug("assigning cache %r to function %s" % (cache, func.__name__))
@wraps(func)
def wrapped_func(*args, **kwargs):
try:
ret = cache[args]
logger.debug("cached value returned for function %s" % func.__name__)
return ret
except KeyError:
try:
ret = func(*args, **kwargs)
except:
raise
else:
logger.debug("cache updated for function %s" % func.__name__)
cache[args] = ret
return ret
return wrapped_func
return decorator
class LRU(OrderedDict):
"""
Custom implementation of a LRU cache, build on top of an Ordered dict.
"""
__slots__ = "_hits", "_misses", "_maxsize"
def __new__(cls, maxsize=128):
if maxsize is None:
return None
return super().__new__(cls, maxsize=maxsize)
def __init__(self, maxsize=128, *args, **kwargs):
self.maxsize = maxsize
self._hits = 0
self._misses = 0
super().__init__(*args, **kwargs)
def __getitem__(self, key):
try:
value = super().__getitem__(key)
except KeyError:
self._misses += 1
raise
else:
self.move_to_end(key)
self._hits += 1
return value
def __setitem__(self, key, value):
super().__setitem__(key, value)
if len(self) > self._maxsize:
oldest, = next(iter(self))
del self[oldest]
def __delitem__(self, key):
try:
super().__delitem__((key,))
except KeyError:
pass
def __repr__(self):
return "<%s object at %s: %s>" % (self.__class__.__name__, hex(id(self)), self.cache_info())
def cache_info(self):
return CacheInfo(self._hits, self._misses, self._maxsize, len(self))
def clear(self):
super().clear()
self._hits, self._misses = 0, 0
@property
def maxsize(self):
return self._maxsize
@maxsize.setter
def maxsize(self, maxsize):
if not isinstance(maxsize, int):
raise TypeError
elif maxsize < 2:
raise ValueError
elif maxsize & (maxsize - 1) != 0:
logger.warning("LRU feature performs best when maxsize is a power-of-two, maybe.")
while maxsize < len(self):
oldest, = next(iter(self))
print(oldest)
del self[oldest]
self._maxsize = maxsize
编辑:我已经使用 cmets 中建议的 __wrapped__ 属性更新了我的代码,并且运行良好!整件事都在这里:https://gist.github.com/fbparis/b3ddd5673b603b42c880974b23db7cda (kik.set_cache() 方法...)
【问题讨论】:
-
"也许有办法从装饰函数中检索它" 也许,不幸的是我们不知道装饰函数是什么。
-
@Goyo “装饰函数”是
_greedy_function,由my_cache_decorator生成。所以这个问题已经很明确了。不过,如果 PO 能提供更多装饰器的上下文会更好。 -
lru_cache在您的课堂上是如何使用的?声明后我没有看到对它的任何引用。 -
通常包装器为此目的提供
__wrapped__属性。也就是说,我建议使用/制作一个提供开关的包装器,而不是删除和恢复包装器。 -
没有理由将
setattr/getattr与标识符一起用作字符串文字。
标签: python python-3.x python-decorators