Python Developer

I am adding airflow to a web application that manually adds a directory containing business logic t… Read more How To Run Airflow With Celeryexecutor On A Custom Docker Image

I am building REST API with Flask-restplus. One of my endpoints takes a file uploaded from client a… Read more How Do I Run Background Job In Flask Without Threading Or Task-queue

In docs link about expires # Task expires after one minute from now. add.apply_async(args=[10, 10],… Read more Celery Expires - Rise Exception

I am using celery to run long running tasks on Hadoop. Each task executes a Pig script on Hadoop wh… Read more Initializing Different Celery Workers With Different Values

I have a celery task which takes about 6 hours. At the end of it, Django (or possibly Celery) rais… Read more Long Celery Task Causes Mysql Timeout In Django - Options?

I'm trying to pause a celery task temporary based on user button click. What I've done is: … Read more Pause Celery Task

I have a few questions regarding task routing, concurrency and performance. Here is my use case : I… Read more Celeryd_concurrency, --concurrency And Autoscale

This question is a follow up of django + celery: disable prefetch for one worker, Is there a bug? I… Read more Celery: Different Settings For Task_acks_late Per Worker / Add Custom Option To Celery

I have celery running locally by just running celery -A proj -l info (although I don't even kno… Read more How Can I Configure Celery To Run On Startup Of Nginx?

I had run celery for my project using 10 threads. It worked perfectly. Now, when i use the command:… Read more Celery Stuck At Mingle: Searching For Neighbors, Doesn't Get To Ready State

I have a flask app using Celery with RabbitMQ as the broker. I've followed the instructions in … Read more Amqp Connection Reset By Peer, But Celery Connected

It looks like celery does not release memory after task finished. Every time a task finishes, there… Read more Celery Does Not Release Memory

My main problem relies on the fact that i need to know if a task is still queued, started or revoke… Read more Celery Task Custom Tracking Method

I have a Celery cluster made up of machines with 8-core processors. Each machine has one worker th… Read more Celery Not Using All Concurrent Slots

I want to use jupyter kernels in side the celery worker. There will be one Jupyter Kernel for each … Read more Accessing Celery Worker Instance Inside The Task

I'm using Celery (3.0.15) with Redis as a broker. Is there a straightforward way to query the n… Read more How To Inspect And Cancel Celery Tasks By Task Name

I have a simple application that sends & receives messages, kombu, and uses Celery to task the … Read more Kombu/celery Messaging

How can someone invoke a celery task from tornado, and get the result via a callback? This post c… Read more Invoke Celery Task From Tornado

I am trying to get celery tasks wrapper around a python object method. Like: class A: @task … Read more Celery Python Object Methods

I want to use Celery for a Url grabber. I have a list of Url, and I must do a HTTP request on every… Read more Combining Chains, Groups And Chunks With Celery