feat: Added EXP Changes, Model updates & End to End tests #1828

Roopan-Microsoft · 2025-06-12T03:17:32Z

Purpose

This pull request introduces several updates across configuration files, documentation, and code to enhance functionality and align with updated dependencies. Key changes include the addition of new environment variables, updates to workflows for testing and automation, migration to the gpt-4.1 model, and improvements to documentation for deployment and authentication setup.

Configuration Updates:

.env.sample: Added AZURE_COSMOSDB_ACCOUNT_KEY to support CosmosDB authentication.

Workflow Enhancements:

.github/workflows/ci.yml: Modified the runCmd to include optional arguments for testing, enabling more flexible test execution.
.github/workflows/test-automation.yml: Introduced a new workflow for end-to-end test automation, including retry mechanisms and detailed reporting with notifications.
.github/workflows/tests.yml: Updated Python test command to specify the test directory explicitly, improving clarity and execution control.

Model Migration:

Multiple files (README.md, env_helper.py, test files, and documentation): Migrated from gpt-4o to gpt-4.1 across configurations, code, and documentation to leverage the latest model capabilities. [1] [2] [3] [4] [5]

Documentation Improvements:

docs/LOCAL_DEPLOYMENT.md: Added instructions for reusing existing Log Analytics workspaces and Resource Groups during deployment.
docs/azure_app_service_auth_setup.md: Enhanced steps for configuring authentication in Azure App Service, including prerequisites and detailed provider setup.

Code Enhancements:

code/backend/pages/01_Ingest_Data.py: Added validation to ensure at least one valid URL is provided during data ingestion, improving error handling.

Does this introduce a breaking change?

Yes
No

How to Test

Get the code

git clone [repo-address]
cd [repo-name]
git checkout [branch-name]
npm install

Test the code

What to Check

Verify that the following are valid

...

Other Information

… changes (#1509)

Co-authored-by: Roopan P M <v-roopanpm@microsoft.com>

…-data-solution-accelerator into dev

Co-authored-by: Roopan P M <v-roopanpm@microsoft.com>

Co-authored-by: Ajit Padhi <v-padhiajit@microsoft.com>

Co-authored-by: Roopan-Microsoft <168007406+Roopan-Microsoft@users.noreply.github.com>

Co-authored-by: Roopan-Microsoft <168007406+Roopan-Microsoft@users.noreply.github.com> Co-authored-by: Ross Smith <ross-p-smith@users.noreply.github.com> Co-authored-by: gpickett <122489228+gpickett@users.noreply.github.com> Co-authored-by: Francia Riesco <friesco@microsoft.com> Co-authored-by: Francia Riesco <Fr4nc3@users.noreply.github.com> Co-authored-by: Prajwal D C <v-dcprajwal@microsoft.com>

…1569)

…nd Update Conversation flow based on template selection (#1567) Co-authored-by: Pavan Kumar <v-kupavan.microsoft.com>

…1572)

…1574)

Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Pavan-Microsoft <v-kupavan@microsoft.com>

…WYD (#1603)

….env File (#1809)

…1811)

…nowledge Base' (CWYD) (#1816)

… CWYD (#1818)

…ing deployment (#1819)

Co-authored-by: Harmanpreet Kaur <v-harmanpkau@microsoft.com>

…ra (#1822) Co-authored-by: Harmanpreet Kaur <v-harmanpkau@microsoft.com>

Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Prasanjeet-Microsoft <v-singhprasa@microsoft.com> Co-authored-by: Roopan-Microsoft <168007406+Roopan-Microsoft@users.noreply.github.com> Co-authored-by: Ajit Padhi <v-padhiajit@microsoft.com> Co-authored-by: Roopan P M <v-roopanpm@microsoft.com> Co-authored-by: Pavan-Microsoft <v-kupavan@microsoft.com> Co-authored-by: Ross Smith <ross-p-smith@users.noreply.github.com> Co-authored-by: gpickett <122489228+gpickett@users.noreply.github.com> Co-authored-by: Francia Riesco <friesco@microsoft.com> Co-authored-by: Francia Riesco <Fr4nc3@users.noreply.github.com> Co-authored-by: Harmanpreet-Microsoft <v-harmanprka@microsoft.com> Co-authored-by: UtkarshMishra-Microsoft <v-utkamishra@microsoft.com> Co-authored-by: Priyanka-Microsoft <v-prisinghal@microsoft.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kiran-Siluveru-Microsoft <v-ksiluveru@microsoft.com> Co-authored-by: Prashant-Microsoft <v-pmalusare@microsoft.com> Co-authored-by: Rohini-Microsoft <v-rwalunj@microsoft.com> Co-authored-by: Avijit-Microsoft <v-aghorui@microsoft.com> Co-authored-by: RaviKiran-Microsoft <v-ravikirans@microsoft.com> Co-authored-by: Somesh Joshi <v-somejoshi@microsoft.com> Co-authored-by: Himanshi Agrawal <v-himagrawal@microsoft.com> Co-authored-by: pradeepjha-microsoft <v-pradeepjha@microsoft.com> Co-authored-by: Harmanpreet Kaur <v-harmanpkau@microsoft.com> Co-authored-by: Bangarraju-Microsoft <v-golib@microsoft.com> Co-authored-by: Harsh-Microsoft <v-hbangera@microsoft.com> Co-authored-by: Kanchan-Microsoft <v-knagshetti@microsoft.com> Co-authored-by: Cristopher Coronado <cristofima@hotmail.com> Co-authored-by: Cristopher Coronado Moreira <crcorona@pichincha.com> Co-authored-by: Vamshi-Microsoft <v-vamolla@microsoft.com> Co-authored-by: Thanusree-Microsoft <168087422+Thanusree-Microsoft@users.noreply.github.com>

…1827) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: Thanusree-Microsoft <168087422+Thanusree-Microsoft@users.noreply.github.com> Co-authored-by: Prasanjeet-Microsoft <v-singhprasa@microsoft.com> Co-authored-by: Roopan-Microsoft <168007406+Roopan-Microsoft@users.noreply.github.com> Co-authored-by: Ajit Padhi <v-padhiajit@microsoft.com> Co-authored-by: Roopan P M <v-roopanpm@microsoft.com> Co-authored-by: Pavan-Microsoft <v-kupavan@microsoft.com> Co-authored-by: Ross Smith <ross-p-smith@users.noreply.github.com> Co-authored-by: gpickett <122489228+gpickett@users.noreply.github.com> Co-authored-by: Francia Riesco <friesco@microsoft.com> Co-authored-by: Francia Riesco <Fr4nc3@users.noreply.github.com> Co-authored-by: Harmanpreet-Microsoft <v-harmanprka@microsoft.com> Co-authored-by: UtkarshMishra-Microsoft <v-utkamishra@microsoft.com> Co-authored-by: Priyanka-Microsoft <v-prisinghal@microsoft.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Kiran-Siluveru-Microsoft <v-ksiluveru@microsoft.com> Co-authored-by: Prashant-Microsoft <v-pmalusare@microsoft.com> Co-authored-by: Rohini-Microsoft <v-rwalunj@microsoft.com> Co-authored-by: Avijit-Microsoft <v-aghorui@microsoft.com> Co-authored-by: RaviKiran-Microsoft <v-ravikirans@microsoft.com> Co-authored-by: Somesh Joshi <v-somejoshi@microsoft.com> Co-authored-by: Himanshi Agrawal <v-himagrawal@microsoft.com> Co-authored-by: pradeepjha-microsoft <v-pradeepjha@microsoft.com> Co-authored-by: Harmanpreet Kaur <v-harmanpkau@microsoft.com> Co-authored-by: Bangarraju-Microsoft <v-golib@microsoft.com> Co-authored-by: Harsh-Microsoft <v-hbangera@microsoft.com> Co-authored-by: Kanchan-Microsoft <v-knagshetti@microsoft.com> Co-authored-by: Cristopher Coronado <cristofima@hotmail.com> Co-authored-by: Cristopher Coronado Moreira <crcorona@pichincha.com> Co-authored-by: Vamshi-Microsoft <v-vamolla@microsoft.com> Co-authored-by: Niraj Chaudhari (Persistent Systems Inc) <v-nirajcha@microsoft.com>

.github/workflows/test-automation.yml

feat: Added EXP Changes, Model updates & End to End tests (Azure-Samples#1828)

Roopan-Microsoft and others added 30 commits November 25, 2024 16:02

ci: Updated workflow to handle main, dev and demo branch | Dependabot…

2dbb0b1

… changes (#1509)

fix: SFI Fixes & scope reverted to subscription (#1513)

97ced9f

ci: workflow updated for build docker (#1514)

903c259

ci: build docker updated for dev (#1522)

4cf2972

ci: workflow branch code updated (#1525)

9158819

updated comment

4545a48

updated workflow

84a33b5

updated workflow

f8c1c8f

updated workflow

e31a661

updated bicep for registry

847ce7e

fixed bicep

8f8cc98

fix: bicep updated (#1527)

15b948c

Co-authored-by: Roopan P M <v-roopanpm@microsoft.com>

Merge branch 'main' into dev

1645e43

Merge branch 'dev' of https://github.com/Azure-Samples/chat-with-your…

8df387a

…-data-solution-accelerator into dev

fix: Container issue fix for multiple branch (#1539)

e4dd5f2

fix: Updated workflow (#1540)

88d06dc

Co-authored-by: Roopan P M <v-roopanpm@microsoft.com>

ci: Psl container fix for checkout code from head branch (#1541)

e5cf4dd

Co-authored-by: Ajit Padhi <v-padhiajit@microsoft.com>

fix: multiple container tag issue fix (#1552)

02d0056

Co-authored-by: Roopan-Microsoft <168007406+Roopan-Microsoft@users.noreply.github.com>

fix: Workflow issue fix on docker image (#1554)

90e1040

Co-authored-by: Roopan-Microsoft <168007406+Roopan-Microsoft@users.noreply.github.com>

fix: CWYD Citation Links to Documents Break After Specific Timeframe (#…

131c323

…1569)

fix: Commit changes bug (#1568)

93b84ed

fix: Post-Deployment Script for Managing Bicep Outputs in .env File a…

0875b92

…nd Update Conversation flow based on template selection (#1567) Co-authored-by: Pavan Kumar <v-kupavan.microsoft.com>

fix: import error in env_helper.py (#1571)

76190b3

fix: add conversation flow in environment variable for adminweb app (#…

c65bf01

…1572)

fix: Update Hosting Model Configuration in ARM/Bicep Template (#1570)

1f326d9

fix: Update main.json for changes conversation flow changes in bicep (#…

fc688c2

…1574)

Merge branch 'main' into dev

56adb59

build: Dependabotchanges merge to Dev branch (#1602)

afaabdc

Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: Pavan-Microsoft <v-kupavan@microsoft.com>

feat: Configurable System Prompts for Flexibility and Maintenance - C…

03f52b3

…WYD (#1603)

Vamshi-Microsoft and others added 14 commits May 13, 2025 17:24

fix: Changed the button label from "Reset Now" to "Reset" (#1796)

a9d8511

Merge branch 'main' into dev

88caa69

main json updated

5383461

fix: hardcoded abbreviations in bicep (#1805)

86ebab4

fix: Enhance Bicep Outputs for Environment Variable Configuration in …

03606b7

….env File (#1809)

fix: Add Cosmos DB Account Key Output for Environment Configuration (#…

7ae4b79

…1811)

fix: error in 'Process and Ingest Web Pages' under 'Add URLs to the K…

69669bb

…nowledge Base' (CWYD) (#1816)

test: Migrate test automation scripts, llm evaluator and pipeline for…

464139c

… CWYD (#1818)

ci: configuration to include optional arguments for running tests dur…

27211e9

…ing deployment (#1819)

Merge branch 'main' into dev

4fec5b7

test: add citation link interaction support to e2e tests (#1821)

b3fcae0

Co-authored-by: Harmanpreet Kaur <v-harmanpkau@microsoft.com>

chore: update default OpenAI model to gpt-4.1 across codebase and inf…

f075a9b

…ra (#1822) Co-authored-by: Harmanpreet Kaur <v-harmanpkau@microsoft.com>

Roopan-Microsoft requested review from Avijit-Microsoft, Prajwal-Microsoft, Fr4nc3 and Vinay-Microsoft as code owners June 12, 2025 03:17

github-advanced-security bot found potential problems Jun 12, 2025

View reviewed changes

.github/workflows/test-automation.yml Fixed Show fixed Hide fixed

feat: rebuilt main.json

74e1d6c

Prajwal-Microsoft changed the title ~~Dev~~ feat: Added EXP Changes, Model updates & End to End tests Jun 16, 2025

Prajwal-Microsoft previously approved these changes Jun 16, 2025

View reviewed changes

Merge branch 'main' into dev

eccd758

Roopan-Microsoft dismissed Prajwal-Microsoft’s stale review via eccd758 June 16, 2025 13:05

Prajwal-Microsoft self-requested a review June 16, 2025 13:08

Prajwal-Microsoft approved these changes Jun 16, 2025

View reviewed changes

Roopan-Microsoft added this pull request to the merge queue Jun 17, 2025

Merged via the queue into main with commit df2e40a Jun 17, 2025
18 checks passed

Harmanpreet-Microsoft added a commit to Harmanpreet-Microsoft/chat-with-your-data-solution-accelerator that referenced this pull request Jun 17, 2025

Merge pull request #1 from Azure-Samples/main

ffc600d

feat: Added EXP Changes, Model updates & End to End tests (Azure-Samples#1828)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: Added EXP Changes, Model updates & End to End tests #1828

feat: Added EXP Changes, Model updates & End to End tests #1828

Uh oh!

Roopan-Microsoft commented Jun 12, 2025 •

edited

Loading

Uh oh!

Uh oh!

Uh oh!

Uh oh!

feat: Added EXP Changes, Model updates & End to End tests #1828

feat: Added EXP Changes, Model updates & End to End tests #1828

Uh oh!

Conversation

Roopan-Microsoft commented Jun 12, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Configuration Updates:

Workflow Enhancements:

Model Migration:

Documentation Improvements:

Code Enhancements:

Does this introduce a breaking change?

How to Test

What to Check

Other Information

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Roopan-Microsoft commented Jun 12, 2025 •

edited

Loading