We migrated 13 tables from 0chain and 0box and building them from events in 0chain using kafka : -t blobbers -t validators -t miners -t sharders -t authorizers -t blobber_snapshots -t validator_snapshots -t miner_snapshots -t sharder_snapshots -t authorizer_snapshots -t users -t user_snapshots -t provider_rewards
.
To make sure the data is consistent and is not breaking, we need to write tests to compare the data in the end of system tests run. We have 2 approaches to deal with it :
- We should have multiple endpoints to share all the fields of all the tables above on both 0chain and 0box. If some fields are missing then we can add them as test endpoints.
- We can just create 2 endpoints that can return us the result of db query. We can use it to get and compare data of all fields and run them only when network is deployed on test mode.
We can discuss more ideas or use hybrid approach as well.