feat: Enhance deployment pipeline, modularize test workflows, simplify infra, and update docs

[Shreyas-Microsoft]

Purpose

This pull request introduces significant updates to the deployment pipeline, test automation workflows, infrastructure configuration, and documentation. The changes aim to enhance deployment flexibility, improve test automation integration, streamline infrastructure definitions, and clarify documentation for end-users.

Deployment Pipeline Enhancements:

• Updated .github/workflows/deploy.yml to trigger on workflow_run and added support for multiple branches (main, dev, demo) and manual dispatch. Introduced new environment variables (GPT_MIN_CAPACITY, BRANCH_NAME) to customize deployments.
• Added logic to dynamically set the image tag based on the branch name and updated Bicep deployment parameters to include capacity and imageVersion.
• Introduced e2e-test and cleanup-deployment jobs to automate testing and resource cleanup post-deployment.

Test Automation Workflow Updates:

• Refactored .github/workflows/test-automation.yml to use workflow_call for modular integration, allowing inputs like CODEMOD_WEB_URL. Removed container app start/stop steps to simplify the workflow. [1] [2] [3]
• Added a step to open the provided URL for testing purposes.

Infrastructure and Configuration Changes:

• Updated infra/deploy_ai_foundry.bicep to remove unused resources like storage accounts and AI Hub, simplifying the Bicep template.
• Added new abbreviations for AI Foundry in infra/abbreviations.json.

Documentation Improvements:

• Updated default Azure locations and clarified parameters in docs/CustomizingAzdParameters.md and docs/DeploymentGuide.md. Added a new parameter AZURE_AISERVICE_LOCATION for AI service location. [1] [2]

Minor Fixes:

• Adjusted scripts in azure.yaml to ensure proper handling of parameters and enabled interactive mode for better user experience.

Does this introduce a breaking change?

• Yes
• No

Golden Path Validation

• I have tested the primary workflows (the "golden path") to ensure they function correctly without errors.

Deployment Validation

• I have validated the deployment process successfully and all services are running as expected with this change.

What to Check

Verify that the following are valid

• ...

Other Information