Skip to content

dlq_purge: Show what queues messages came from #264

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Jun 17, 2025
Merged

dlq_purge: Show what queues messages came from #264

merged 3 commits into from
Jun 17, 2025

Conversation

ndevenish
Copy link
Contributor

Now shows which queues messages came from, instead of mixing together outputs in somewhat arbitrary order. New output:

Looking for DLQ messages in 38 queues...
Found 13 DLQ messages in dlq.ispyb_connector
    Message 1 (2025-06-16 13:27:41) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-132741-000-1
    Message 2 (2025-06-16 13:27:41) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-132741-000-2
    Message 3 (2025-06-16 13:27:41) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-132741-000-3
    Message 4 (2025-06-16 13:27:41) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-132741-000-4
Done.

Also, accepts dlq.* names in rabbitmq, stripping off the dlq. part if present.

@ndevenish
Copy link
Contributor Author

ndevenish commented Jun 17, 2025

Tested with multiple queues

Looking for DLQ messages in 38 queues...
Found 2 DLQ messages in dlq.cloudwatcher
    Message 1 (2025-06-17 10:35:25) exported:
        /dls/tmp/zocalo/DLQ/2025-06-17/msg-20250617-103525-000-1
    Message 2 (2025-06-17 10:35:32) exported:
        /dls/tmp/zocalo/DLQ/2025-06-17/msg-20250617-103532-000-2
Found 1 DLQ messages in dlq.cluster.submission
    Message 1 (2025-06-17 10:43:16) exported:
        /dls/tmp/zocalo/DLQ/2025-06-17/msg-20250617-104316-000-1
Found 330 DLQ messages in dlq.per_image_analysis
    Message 1 (2025-06-16 19:21:53) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-192153-000-1
    Message 2 (2025-06-16 19:21:53) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-192153-000-2
    Message 3 (2025-06-16 19:21:53) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-192153-000-3
    Message 4 (2025-06-16 19:21:53) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-192153-000-4
    Message 5 (2025-06-16 19:21:53) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-192153-000-5
...
    Message 330 (2025-06-16 19:21:56) exported:
        /dls/tmp/zocalo/DLQ/2025-06-16/msg-20250616-192156-000-330
Done.

@ndevenish ndevenish merged commit 6498138 into main Jun 17, 2025
7 checks passed
@ndevenish ndevenish deleted the purge_match branch June 17, 2025 10:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant