Update gcp collector

[1cadumagalhaes]

Hey!
I got some errors on the GCP collector related to StreamingBuffer and SnapshotDefinition, and then when trying to fix it also got an error on MetadataExtension.
Since this package still points to the image in the old repo I thought it would be easier for me to fork that one so I can use the image already.
Should I fork this one and contribute here? I also made a patch to work with python 3.12, and chose to use uv and ruff instead of poetry and black (I tried updating dependencies with poetry and took a few minutes, uv is just fast)
Anyway, the changes on the biguery collector are here: https://github.com/Retize-io/odd-collector-gcp

[1cadumagalhaes]

Also, any reason why they are still separate collectors? I feel like RDS, S3, GCS, BigQuery should be part of the default collection. For me it is weird that the platform just considers all of them "Other" directory

[RamanDamayeu]

Hi @1cadumagalhaes , thank you for your interest and desire to contribute!
You are absolutely right that a fork should be made of these repository, once you prepare the PR, we can discuss it!
Regarding different applications for different platforms, as well as the presence of cloud agnostic "general" applications (for Postgres, Snowflake, etc.). In fact, the only reason to separate them into different applications is to reduce the headache with dependency and reduce the images. For instance, if the application is planned for use with AWS services, do not overload it with packages that will never be needed there. But on the other hand, there are more applications (4 at the moment) that need to be supported. Historically, all the adapters were separate applications, then they merged into one, then they moved apart according to the specifics of the clouds. Who knows how the configuration will be in the future, it will be based on what is more convenient.

[RamanDamayeu]

Here is a location of GCP adapters: https://github.com/opendatadiscovery/odd-collectors/tree/main/odd-collector-gcp
btw, more about the Git Org Structure: https://docs.opendatadiscovery.org/developer-guides/github-organization-overview