GSoC 2025: Selecting database management library for AtomDB refactor: PyTables alternative

[gabrielasd]

This discussion is part of the refactor initiative of AtomDB API as part of the GSoC 2025 project described in issue #141

We're evaluating options for a database library for this project. The main requirement is to improve the current slow and complicated (de)serialization method that uses MsgPack.

We were considered using TinyDB as the database library for the new API, but PyTables may be a better option in our case since it is "build on top of HDF5 library and NumPy".

@enjyashraf18, @msricher, @marco-2023, @FarnazH, @PaulWAyers
feel free to comment below which one do you consider would be best based on pros, cons, or any other considerations.

[PaulWAyers]

I don't have a strong preference. PyTables seems to be better maintained (more recent commits) with several recent major contributors, while TinyDB has few recent commits and only one significant contributor. So I feel like PyTables is the more sustainable option, probably.