Skip to content

Make lookup tables shared between threads #703

@dr0i

Description

@dr0i

If threads are use in a Flux , resulting in parallel Fixes, all lookup tables are loaded per instance of Fix. As these tables are read-only we could make them shared by all thread.

Impact: less memory consumption (depending on the number of thread involved)
Afaik only one project is using threads in a Flux (namely https://github.com/hbz/lobid-resources) using 8 threads. Memory consumption is now ~ 22GB and would shrink to around 5GB.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions