Page 1 of 1

Starting queued tasks

Posted: Mon Mar 23, 2020 3:38 pm
by Nevga
Hello there, I'm new to Mayan and relatively new to using Linux on a slightly more advanced level after just using it the way I used MacOS before. Equipped with the E-Book and the documentation, I managed to install Mayan (simple Docker installation on Linux Mint). I am able to add documents manually, but I am struggling to get my watch folder to work after following the instructions to access outside data. It dawned on me that it might have something to do with the fact that every tool I click on in Mayan (like: create index or "check watch folder") just elicits a message in the upper right corner saying that the task has been added to the queue. Now on to my newbie question: How to I get these tasks to be executed? Has this got anything to do with Celery? To be honest, I do not really get the Celery/RabbitMQ bit, these terms hardly show up in the E-Book and the documentation. If you think I'm completely clueless and it needs to much effort to explain these things to me, just tell me so and I'd be fine with that ;)

Re: Starting queued tasks

Posted: Tue Mar 24, 2020 9:36 pm
by rosarior

It is true that these are background tasks that are executed by a worker process. RabbitMQ is a third party product that works as a messaging medium to send the tasks requests between the frontend and the backend workers. Celery is the Python library we use to handle all of this and avoid us having to code the background task system from scratch.

The Docker image takes care of all of this for you. It launches a frontend process to show a web interface and a background worker to process the tasks. The default installation uses a Redis container as the message broker as it is more lightweight (RabbitMQ is meant for high volume/document installations).

Check the watch folder log button for details, it is usually a Linux user permission issue when using Docker due to their permission mapping scheme employed.

Re: Starting queued tasks

Posted: Wed Mar 25, 2020 8:16 am
by Nevga
Thank you very much for your quick reply (and an excellent product). I will try to find the error - now that I know where to look for it.