【问题标题】:Celery connecting to rabbitmq-server instead of redis-server芹菜连接到rabbitmq-server而不是redis-server
【发布时间】:2019-04-23 16:52:59
【问题描述】:

我有一个 Django 应用程序,我想将它配置为 celery 以运行后台任务。

包:

  1. celery==4.2.1

  2. Django==2.1.3

  3. Python==3.5

  4. Redis-server==3.0.6

settings.py文件中celery的配置为:

CELERY_BROKER_URL = 'redis://localhost:6379'

CELERY_RESULT_BACKEND = 'redis://localhost:6379'
CELERY_ACCEPT_CONTENT = ['application/json']
CELERY_RESULT_SERIALIZER = 'json'
CELERY_TASK_SERIALIZER = 'json'
CELERY_TIMEZONE = 'Asia/Kolkata'
CELERY_BEAT_SCHEDULE = {
    'task-number-one': {
            'task': 'app.tasks.task_number_one',
            'schedule': crontab(minute='*/1'),
    },
}

还有celery.py文件:

from __future__ import absolute_import, unicode_literals
import os
from celery import Celery
from django.conf import settings
# set the default Django settings module for the 'celery' program.
os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'project.settings.prod')

app = Celery('project')

# Using a string here means the worker don't have to serialize
# the configuration object to child processes.
# - namespace='CELERY' means all celery-related configuration keys
#   should have a `CELERY_` prefix.
app.config_from_object('django.conf:settings')

# Load task modules from all registered Django app configs.
app.autodiscover_tasks(lambda: settings.INSTALLED_APPS)


@app.task(bind=True)
def debug_task(self):
    print('Request: {0!r}'.format(self.request))

当我跑步时:celery -A project worker -l info -B -E

它指向rabmmitmq server,而不应该指向redis-server,如下所示:

 -------------- celery@user-desktop v4.2.1 (windowlicker)
---- **** ----- 
--- * ***  * -- Linux-4.15.0-39-generic-x86_64-with-Ubuntu-18.04-bionic 2018-11-21 12:04:51
-- * - **** --- 
- ** ---------- [config]
- ** ---------- .> app:         project:0x7f8b80f78d30
- ** ---------- .> transport:   amqp://guest:**@localhost:5672//
- ** ---------- .> results:     redis://localhost:6379/
- *** --- * --- .> concurrency: 4 (prefork)
-- ******* ---- .> task events: ON
--- ***** ----- 
 -------------- [queues]
                .> celery           exchange=celery(direct) key=celery


[tasks]
  . app.tasks.task_number_one
  . project.celery.debug_task

[2018-11-21 12:04:51,741: INFO/Beat] beat: Starting...

同样的情况也发生在生产环境中。 在生产中,我已经使用 Gunicorn 和 Nginx 部署了 Django 应用程序,现在我想实现一些方法来运行后台任务,因为 django-crontab 包不起作用。

问题:

  1. celery 配置有什么问题?

  2. 谁能推荐一种运行周期性后台任务的方法?

**注意:我尝试过实现supervisor,但是supervisor似乎与python3不兼容,因此无法配置。

【问题讨论】:

    标签: django celery background-process redis-server


    【解决方案1】:

    broker url changed in v4 的设置。它应该是BROKER_URL 而不是CELERY_BROKER_URL

    【讨论】:

      【解决方案2】:

      如果你从celery官网https://docs.celeryproject.org/en/latest/django/first-steps-with-django.html复制了celery.py的内容

      尝试更改以下行,从

      app.config_from_object('django.conf:settings', namespace='CELERY')

      app.config_from_object('django.conf:settings', namespace='')

      【讨论】:

        【解决方案3】:

        替换 CELERY_BROKER_URL = 'redis://localhost:6379'BROKER_URL = 'redis://localhost:6379'。这对我有用。

        【讨论】:

          猜你喜欢
          • 1970-01-01
          • 2020-06-29
          • 2013-06-09
          • 1970-01-01
          • 2019-04-05
          • 2013-06-07
          • 2013-11-17
          • 2014-11-06
          • 1970-01-01
          相关资源
          最近更新 更多