data_usage does not reflect actual usage #836
Description
Bug Description
Data usage does not reflect actual data usage because RDS records remain even after files have been deleted. This maybe occurs when user deletes records while RDS is not running
Steps to Reproduce
Expected Behavior
RDS should update data tables based on actual experimental records.
Maybe we need to add something in main.py that synchronises the RDS at startup?
Actual Behavior
RDS only seems to delete records when they are deleted during an active session.
Environment
- OS: macOS
- Browser: Chrome
Priority
Classify the severity of this bug as [Low, Medium, High, Critical].
- Low: Minimal impact on functionality, can be fixed in a future release.
Screenshots/Logs
Displayed usage: 14.75GB
Actual usage much lower
Cause: RDS has old data
mysql> select * from experiment_records;
+----+--------------+-----------+------------+---------------------+---------------------+
| id | workspace_id | uid | data_usage | created_at | updated_at |
+----+--------------+-----------+------------+---------------------+---------------------+
| 3 | 1 | 61af978a | 441961242 | 2025-05-28 11:13:37 | 2025-05-28 11:13:37 |
| 11 | 1 | e0ed851e | 517063860 | 2025-05-30 10:28:51 | 2025-05-30 10:29:30 |
| 12 | 1 | cb423327 | 605034089 | 2025-05-30 10:37:32 | 2025-05-30 10:49:53 |
| 13 | 1 | a24d295d | 605020697 | 2025-05-30 10:51:01 | 2025-06-03 21:11:12 |
| 14 | 1 | 9f23852a | 603772678 | 2025-05-30 10:56:28 | 2025-05-30 10:57:23 |
| 16 | 1 | 29e9e2c2 | 829791240 | 2025-05-30 11:12:26 | 2025-05-30 11:28:41 |
| 17 | 1 | 52ec8c76 | 530495460 | 2025-05-30 11:17:49 | 2025-05-30 11:18:23 |
| 18 | 1 | b6b6f5b9 | 829779081 | 2025-05-30 13:47:21 | 2025-05-30 13:49:27 |
| 19 | 1 | 70f3a0c0 | 856921687 | 2025-05-30 14:11:04 | 2025-06-02 10:04:01 |
| 21 | 1 | b1a01adb | 266745965 | 2025-06-02 14:40:01 | 2025-06-03 17:36:16 |
| 22 | 1 | 8f0d1356 | 684207642 | 2025-06-02 15:25:29 | 2025-06-03 20:46:03 |
| 23 | 1 | d56e399c | 605455105 | 2025-06-02 17:27:05 | 2025-06-03 14:01:06 |
| 25 | 1 | f57f3f90 | 677400481 | 2025-06-03 17:47:24 | 2025-06-03 20:21:20 |
| 26 | 1 | f8522084 | 541215572 | 2025-06-03 20:52:13 | 2025-06-03 21:00:59 |
| 27 | 1 | c5bd9c00 | 829779036 | 2025-06-03 21:03:40 | 2025-06-03 21:05:29 |
| 28 | 1 | 814ed7b3 | 131956456 | 2025-06-03 21:16:54 | 2025-06-03 21:16:56 |
| 29 | 1 | 0bc6941c | 888268 | 2025-06-03 21:22:29 | 2025-06-03 21:23:30 |
| 31 | 1 | 7de86ea6 | 639771031 | 2025-06-04 15:21:07 | 2025-06-04 15:46:52 |
| 32 | 1 | 9b3a1552 | 475674259 | 2025-06-04 19:50:03 | 2025-06-04 19:50:42 |
| 34 | 1 | ee45e681 | 419618786 | 2025-06-05 09:28:16 | 2025-06-05 09:34:18 |
| 35 | 1 | dabe916a | 2186882057 | 2025-06-05 10:05:12 | 2025-06-05 10:06:40 |
| 36 | 1 | 1bb3dc08 | 51580660 | 2025-06-05 11:17:54 | 2025-06-05 11:37:00 |
| 59 | 1 | tutorial1 | 502001259 | 2025-06-10 17:37:53 | 2025-06-10 17:38:33 |
| 60 | 1 | 8035034e | 501570542 | 2025-06-10 17:39:50 | 2025-06-10 17:40:28 |
| 61 | 1 | 8fa08827 | 275647256 | 2025-06-10 17:49:17 | 2025-06-10 17:49:57 |