【发布时间】:2021-06-13 02:16:58
【问题描述】:
问题是我得到以下日志:
celery_1 | [2021-03-15 19:00:00,124: INFO/MainProcess] Scheduler: Sending due task read_dof (api.tasks.read_dof)
celery_1 | [2021-03-15 19:00:00,140: INFO/MainProcess] Scheduler: Sending due task read_bdm (api.tasks.read_bdm)
celery_1 | [2021-03-15 19:00:00,141: INFO/MainProcess] Scheduler: Sending due task read_fixer (api.tasks.read_fixer)
我有以下芹菜配置。 Exchange 是我的 django 项目的名称,即“celery.py”所在的位置,api 是我的 django 应用程序的名称,即我的“tasks.py”所在的位置:
from __future__ import absolute_import, unicode_literals
import os
from celery import Celery
from celery.schedules import crontab
os.environ.setdefault("DJANGO_SETTINGS_MODULE", "exchange.settings")
app = Celery("exchange")
app.config_from_object("django.conf:settings", namespace="CELERY")
app.autodiscover_tasks()
app.conf.beat_schedule = {
'read_bdm': {
'task': 'api.tasks.read_bdm',
'schedule': crontab(hour=19,minute=0),
},
'read_dof': {
'task': 'api.tasks.read_dof',
'schedule': crontab(hour=19,minute=0),
},
'read_fixer': {
'task': 'api.tasks.read_fixer',
'schedule': crontab(hour=19,minute=0),
},
}
这是我的tasks.py:
from celery import shared_task
from .models import BdmExch, DofExch, FixerExch
from .helpers.bdmcrawler import parse_bdm
from .helpers.dofcrawler import parse_dof
from .helpers.fixercrawler import parse_fixer
@shared_task(name='read_bdm')
def read_bdm():
attempts=0
while attempts <3:
try:
result = parse_bdm()
print(result)
BdmExch.objects.create(time=result["date"],exch=result["exc"])
return
except:
attempts += 1
print("Parsing error on read_bdm")
print("--------------- Parsing error on read_bdm -----------")
return
@shared_task(name='read_dof')
def read_dof():
attempts=0
while attempts < 3:
try:
result = parse_dof()
DofExch.objects.create(time=result["date"],exch=result["exc"])
return
except:
attempts += 1
print("Parsing error on read_dof")
print("--------------- Parsing error on read_dof -----------")
return
@shared_task(name='read_fixer')
def read_fixer():
attempts=0
while attempts < 3:
try:
result = parse_bdm()
FixerExch.objects.create(time=result["date"],exch=result["exc"])
return
except:
attempts += 1
print("Parsing error on read_fixer")
print("--------------- Parsing error on read_fixer -----------")
return
正如我所说,这是在 api django 应用程序中,parse_bdm、parse_dof 和 parse_fixer 函数是请求和 beautifulsoup 或简单字典的简单实现,以便从不同来源读取数据。当我像简单函数一样简单地运行任务函数时不会出现任何问题,所以这让我相信我的 celery.py 中存在我似乎无法确定的问题。
非常感谢任何帮助。
非常感谢!
【问题讨论】:
标签: python django celery celerybeat django-celery-beat