tf destroy fails in tf-multienv-cicd-anthos-autopilot #2350
Description
seems to be working well, but hits a snag:
...
google_gke_hub_membership.staging: Destruction complete after 10s
module.gke_staging.google_container_cluster.primary: Destroying... [id=projects/smig-dotslash/locations/us-west1/clusters/staging]
google_gke_hub_membership.production: Still destroying... [id=projects/smig-dotslash/locations/global/memberships/production-membership, 20s elapsed]
google_gke_hub_membership.production: Still destroying... [id=projects/smig-dotslash/locations/global/memberships/production-membership, 30s elapsed]
google_gke_hub_membership.production: Still destroying... [id=projects/smig-dotslash/locations/global/memberships/production-membership, 40s elapsed]
google_gke_hub_membership.production: Destruction complete after 41s
module.gke_production.google_container_cluster.primary: Destroying... [id=projects/smig-dotslash/locations/us-west1/clusters/production]
╷
│ Error: Error trying to delete bucket release-source-staging-frontend-353789472358 containing objects without `force_destroy` set to true
│ Error: Error trying to delete bucket release-source-staging-transactionhistory-353789472358 containing objects without `force_destroy` set to true
│ Error: Error trying to delete bucket delivery-artifacts-staging-353789472358 containing objects without `force_destroy` set to true
│ Error: Cannot destroy cluster because deletion_protection is set to true. Set it to false to proceed with cluster deletion.
│ Error: Error, failed to deleteuser admin in instance bank-of-anthos-db-staging: googleapi: Error 400: Invalid request: failed to delete user admin: . role "admin" cannot be dropped because some objects depend on it Details: 2 objects in database ledger-db
│ 2 objects in database accounts-db., invalid
│ Error: Error trying to delete bucket delivery-artifacts-production-353789472358 containing objects without `force_destroy` set to true
│ Error: Error trying to delete bucket release-source-staging-ledgerwriter-353789472358 containing objects without `force_destroy` set to true
│ Error: Error trying to delete bucket release-source-staging-userservice-353789472358 containing objects without `force_destroy` set to true
│ Error: Error waiting for Deleting SecurityPolicy: The security_policy resource 'projects/smig-dotslash/global/securityPolicies/bank-of-anthos-security-policy' is already being used by 'projects/smig-dotslash/global/backendServices/k8s1-07229d7d-bank-of-anthos-production-frontend-80-6eabf157'
│ Error: Error, failed to deleteuser admin in instance bank-of-anthos-db-production: googleapi: Error 400: Invalid request: failed to delete user admin: . role "admin" cannot be dropped because some objects depend on it Details: 2 objects in database ledger-db., invalid
│ Error: Error when reading or editing SslPolicy: googleapi: Error 400: The ssl_policy resource 'projects/smig-dotslash/global/sslPolicies/bank-of-anthos-ssl-policy' is already being used by 'projects/smig-dotslash/global/targetHttpsProxies/k8s2-ts-2sfznmpp-bank-of-anthos-product-frontend-ingre-zh4c3m5u', resourceInUseByAnotherResource
│ Error: Cannot destroy cluster because deletion_protection is set to true. Set it to false to proceed with cluster deletion.
│ Error: Error when reading or editing Database: googleapi: Error 400: Invalid request: failed to delete database ledger-db. Detail: pq: database "ledger-db" is being accessed by other users., invalid
│ Error: Error trying to delete bucket release-source-staging-contacts-353789472358 containing objects without `force_destroy` set to true
│ Error: Error when reading or editing Database: googleapi: Error 400: Invalid request: failed to delete database ledger-db. Detail: pq: database "ledger-db" is being accessed by other users., invalid
│ Error: Cannot destroy cluster because deletion_protection is set to true. Set it to false to proceed with cluster deletion.
│ Error: Error trying to delete bucket release-source-staging-balancereader-353789472358 containing objects without force_destroy set to true
long (shell history too short) gist is here:
https://gist.github.com/stevemcghee/90da90a404a2979112d7162d222f4d2a