feat: json document processor

[cristofima]

Purpose

• Add the ability to upload JSON files and process them

Does this introduce a breaking change?

• Yes
• No

How to Test

• Get the code

git clone [repo-address]
cd [repo-name]
git checkout [branch-name]

• Test the code

Go to the Admin site. From Ingest Data upload a JSON file
Once the file is processed, go to Explore Data the see the chunks

What to Check

Verify that the following are valid

Check how the code generated the chunks for the JSON file.

Other Information

Try testing with OpenAPI JSON files, but any JSON file is ok.

[cristofima]

@microsoft-github-policy-service agree

[Roopan-Microsoft]

Thanks @cristofima for your contribution, we will validate from our end!

[github-actions]

Coverage Report •

File	Stmts	Miss	Cover	Missing
code/backend/batch/utilities/document_chunking
chunking_strategy.py	16	1	93%	26
json.py	21	12	42%	11, 16, 19–22, 24–27, 36–37
strategies.py	18	5	72%	16–19, 21
code/backend/batch/utilities/helpers/config
config_helper.py	181	2	98%	91, 94
TOTAL	3844	871	77%

Tests	Skipped	Failures	Errors	Time
395	0 💤	4 ❌	0 🔥	54.032s ⏱️

[Roopan-Microsoft]

@cristofima - Apologies for the delay, we have merged your PR and validating your changes in out intermediate branch. Will keep you posted once it is merged into main.