[ENH]: wire GC v2 to new cleanup modes & call FinishDatabaseDeletion from garbage collector (#4671)

## Description of changes

Changes:

- Adds two new cleanup modes, `DryRunV2` and `DeleteV2`. When the
default cleanup mode is set to one of these, or when it is set per
tenant, the v2 garbage collector orchestrator will be used. Otherwise,
the old orchestrator will be used. The default remains the same (the old
orchestrator in dry run mode).
- Adds a config field to the garbage collector config for the root
manager cache config. Has a default.
- Calls `FinishDatabaseDeletion` at the end of each GC cycle. This will
transition eligible soft deleted databases -> hard deleted databases. I
added a test for this.

## Test plan

_How are these changes tested?_

- [x] Tests pass locally with `pytest` for python, `yarn test` for js,
`cargo test` for rust

## Documentation Changes

_Are all docstrings for user-facing APIs updated if required? Do we need
to make documentation changes in the [docs
section](https://github.com/chroma-core/chroma/tree/main/docs/docs.trychroma.com)?_

n/a

Author: codetheweb

rust/garbage_collector/src/config.rs

@@ -1,8 +1,8 @@
-use std::{collections::HashMap, time::Duration};
-
+use chroma_cache::CacheConfig;
 use chroma_storage::config::StorageConfig;
 use chroma_system::DispatcherConfig;
 use figment::providers::{Env, Format, Yaml};
+use std::{collections::HashMap, time::Duration};
 
 use crate::types::CleanupMode;
 
@@ -40,6 +40,8 @@ pub(super) struct GarbageCollectorConfig {
     pub my_member_id: String,
     #[serde(default = "GarbageCollectorConfig::default_port")]
     pub port: u16,
+    #[serde(default)]
+    pub root_cache_config: CacheConfig,
 }
 
 impl GarbageCollectorConfig {