【问题标题】:Django - Celery 4.1 with django-celery-beat/rabbitmq : Nothing?Django - 带有 django-celery-beat/rabbitmq 的 Celery 4.1:什么都没有?
【发布时间】:2018-05-02 13:03:54
【问题描述】:

我按照http://docs.celeryproject.org/en/latest/ 上的教程进行操作,我正在使用 virtualbox (Xubuntu 16.XX TLS)、Django 1.11.3、Celery 4.1。 rabbitmq 3.6.14,Python 2.7。

当我使用 init-script 启动守护进程时:celerybeat (with /etc/default/celeryd config file)

[2017-11-19 01:13:00,912: INFO/MainProcess] 节拍:开始...

之后仅此而已。你知道我会做错什么吗?

我的 celery.py:

from __future__ import absolute_import, unicode_literals
import os
from celery import Celery

# set the default Django settings module for the 'celery' program.
os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'oscar.settings')

app = Celery('oscar')

# Using a string here means the worker doesn't have to serialize
# the configuration object to child processes.
# - namespace='CELERY' means all celery-related configuration keys
#   should have a `CELERY_` prefix.
app.config_from_object('django.conf:settings', namespace='CELERY')

# Broker settings
app.conf.broker_url = 'amqp://oscar:oscar@localhost:5672/oscarRabbit'

# Load task modules from all registered Django app configs.
app.autodiscover_tasks()

some_app/tasks.py:

from __future__ import absolute_import, unicode_literals
from oscar import celery_app
from celery.schedules import crontab
from .models import HelpRequest
from datetime import datetime, timedelta
import logging

""" CONSTANTS FOR THE TIMER """
# Can be changed  (by default 1 week)
WEEKS_BEFORE_PENDING = 0
DAYS_BEFORE_PENDING = 0
HOURS_BEFORE_PENDING = 0
MINUTES_BEFORE_PENDING = 1

# http://docs.celeryproject.org/en/latest/userguide/periodic-tasks.html
# for schedule : http://docs.celeryproject.org/en/latest/userguide/periodic-tasks.html#crontab-schedules
@celery_app.on_after_configure.connect
def setup_periodic_tasks(sender, **kwargs):

    sender.add_periodic_task(
        crontab(minute=2),
        set_open_help_request_to_pending
    )

@celery_app.task(name="HR_OPEN_TO_PENDING")
def set_open_help_request_to_pending():
    """ For timedelay idea : https://stackoverflow.com/a/27869101/6149867  """
    logging.info("RUNNING CRON TASK FOR STUDENT COLLABORATION : set_open_help_request_to_pending")
    request_list = HelpRequest.objects.filter(
        state=HelpRequest.OPEN,
        timestamp__gte=datetime.now() - timedelta(hours=HOURS_BEFORE_PENDING,
                                                  minutes=MINUTES_BEFORE_PENDING,
                                                  days=DAYS_BEFORE_PENDING,
                                                  weeks=WEEKS_BEFORE_PENDING)
    )

    if request_list:
        logging.info("FOUND ", request_list.count(), "  Help request(s) => PENDING")
        for help_request in request_list.all():
            help_request.change_state(HelpRequest.PENDING)

/etc/default/celeryd:

# Names of nodes to start
#   most people will only start one node:
CELERYD_NODES="worker1"
#   but you can also start multiple and configure settings
#   for each in CELERYD_OPTS
#CELERYD_NODES="worker1 worker2 worker3"
#   alternatively, you can specify the number of nodes to start:
#CELERYD_NODES=10

# Absolute or relative path to the 'celery' command:
CELERY_BIN="/home/jy95/Documents/oscareducation/ve/local/bin/celery"

# App instance to use
# comment out this line if you don't use an app
CELERY_APP="oscar"


# Where to chdir at start.
CELERYD_CHDIR="/home/jy95/Documents/oscareducation"

# Extra command-line arguments to the worker
# django_celery_beat for admin purpuse
CELERYD_OPTS="--scheduler django_celery_beat.schedulers:DatabaseScheduler -f /var/log/celery/celery_tasks.log"

# Set logging level to DEBUG
#CELERYD_LOG_LEVEL="DEBUG"

# %n will be replaced with the first part of the nodename.
CELERYD_LOG_FILE="/var/log/celery/%n%I.log"
CELERYD_PID_FILE="/var/run/celery/%n.pid"

# Workers should run as an unprivileged user.
#   You need to create this user manually (or you can choose
#   a user/group combination that already exists (e.g., nobody).
CELERYD_USER="celery"
CELERYD_GROUP="celery"

# If enabled pid and log directories will be created if missing,
# and owned by the userid/group configured.
CELERY_CREATE_DIRS=1

我的rabbitmq设置:

$ sudo rabbitmqctl add_user oscar oscar
$ sudo rabbitmqctl add_vhost oscarRabbit
$ sudo rabbitmqctl set_user_tags oscar administrator
$ sudo rabbitmqctl set_permissions -p oscarRabbit oscar ".*" ".*" ".*"

我运行的命令(及其消息):

sudo rabbitmq-server -detached
sudo /etc/init.d/celerybeat start

警告:PID 文件未写入; - 分离已通过。
/etc/init.d/celerybeat: lerybeat: 未找到
celery 初始化 v10.1.
使用配置:/etc/default/celeryd
开始 celerybeat...

sudo /etc/init.d/celerybeat start
source ve/bin/activate
python manage.py runserver

正在执行系统检查...

系统检查未发现任何问题(0 静音)。
2017 年 11 月 19 日 -01:49:22 Django 版本 1.11.3,使用设置 'oscar.settings'
http://127.0.0.1:8000/启动开发服务器
使用 CONTROL-C 退出服务器。

感谢您的回答

【问题讨论】:

    标签: django linux rabbitmq celery scheduled-tasks


    【解决方案1】:

    看起来你已经启动了一个celerybeat 进程和你的服务器,但是还没有启动一个 celery worker 进程。

    python celery -A proj worker -B
    

    (其中proj 是您的项目名称)。

    请注意,您可以使用 an embedded beat process 启动 celery worker,而无需单独运行 celerybeat

    【讨论】:

    • 谢谢。我守护了beat,但忘了守护工人^^
    猜你喜欢
    • 2019-11-15
    • 2022-01-20
    • 1970-01-01
    • 2015-01-01
    • 1970-01-01
    • 2018-08-04
    • 2019-11-16
    • 2018-12-28
    • 2021-12-01
    相关资源
    最近更新 更多