How to limit worker memory

Hello, i am running mayan edms with workers. multi container configuration.

The issue is I am running out of memory, most likely because the rabbitmq queues get saturated. I would like to increase more workers that will run the task of the affected queues and decrease the memory for other workers.

Is there a way to change worker configration. Maximum memory per child.

Hi,

This is the documentation chapter on changing memory configuration: Environment Variables — Mayan EDMS 4.6.2 documentation

Be aware that this works not by reducing the amount of memory the process uses but by killing the process if the threshold is exceed. Lowering the value too much may end up causing a spawn/kill loop.

https://docs.celeryq.dev/en/stable/userguide/workers.html#max-memory-per-child-setting

Knowledge Base article on scaling up workers: Scaling up a multi container installation

Other relevant articles:

1 Like

This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.