Skip to content

RabbitMQ deployment with storage runs out of space #645

@kierenevans

Description

@kierenevans

There's a directory created for each hostname in the volume /var/lib/rabbitmq/.

As there's no cluster running, each of these hostname directories would have been a fresh instance, as without "shovel"-ing the queues data from one node to another, there's no shared state between instances, even if they were running as a cluster.

Converting to a statefulset would be best to get a consistent naming scheme.

bash-5.1# df -h
Filesystem                Size      Used Available Use% Mounted on
/dev/disk/by-id/scsi-0DO_Volume_pvc-efe13a71-9b55-49da-a97e-68aacba5acd9
                          1.9G      1.8G      4.0K 100% /var/lib/rabbitmq
bash-5.1# ls -la /var/lib/rabbitmq/mnesia/
total 72
drwxr-xr-x   13 rabbitmq rabbitmq      4096 Nov 23 08:00 .
drwxr-xr-x    4 rabbitmq root          4096 Jan 29  2021 ..
drwxr-xr-x    4 rabbitmq rabbitmq      4096 Nov 15 19:15 rabbit@spryker-sample-rabbitmq-67785dfc44-4t6n2
-rw-r--r--    1 rabbitmq rabbitmq       148 Nov 15 19:12 rabbit@spryker-sample-rabbitmq-67785dfc44-4t6n2-feature_flags
drwxr-xr-x   10 rabbitmq rabbitmq      4096 Nov 15 19:12 rabbit@spryker-sample-rabbitmq-67785dfc44-4t6n2-plugins-expand
drwxr-xr-x    3 rabbitmq rabbitmq      4096 Nov 22 19:05 rabbit@spryker-sample-rabbitmq-67785dfc44-8fs46
drwxr-xr-x    4 rabbitmq rabbitmq      4096 Nov 15 19:05 rabbit@spryker-sample-rabbitmq-67785dfc44-dgmch
-rw-r--r--    1 rabbitmq rabbitmq       148 Nov 15 19:05 rabbit@spryker-sample-rabbitmq-67785dfc44-dgmch-feature_flags
drwxr-xr-x   10 rabbitmq rabbitmq      4096 Nov 15 19:05 rabbit@spryker-sample-rabbitmq-67785dfc44-dgmch-plugins-expand
drwxr-xr-x    4 rabbitmq rabbitmq      4096 Feb  8  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-p22w7
-rw-r--r--    1 rabbitmq rabbitmq       148 Feb  8  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-p22w7-feature_flags
drwxr-xr-x   10 rabbitmq rabbitmq      4096 Feb  8  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-p22w7-plugins-expand
drwxr-xr-x    4 rabbitmq rabbitmq      4096 Jan 29  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-s4bjl
-rw-r--r--    1 rabbitmq rabbitmq       148 Jan 29  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-s4bjl-feature_flags
drwxr-xr-x   10 rabbitmq rabbitmq      4096 Jan 29  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-s4bjl-plugins-expand
drwxr-xr-x    4 rabbitmq rabbitmq      4096 Feb  8  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-t84wc
-rw-r--r--    1 rabbitmq rabbitmq       148 Feb  8  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-t84wc-feature_flags
drwxr-xr-x   10 rabbitmq rabbitmq      4096 Feb  8  2021 rabbit@spryker-sample-rabbitmq-67785dfc44-t84wc-plugins-expand

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions