Re-upgrade Claude to Sonnet 4.0 and instructed AI only to explain policies

[SongmingFan123]

Fixes #2522
Fixes #2512

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.15%. Comparing base (a216bc6) to head (4505d80).
Report is 10 commits behind head on master.

Additional details and impacted files

@@            Coverage Diff             @@
##           master    #2540      +/-   ##
==========================================
+ Coverage   63.98%   71.15%   +7.16%     
==========================================
  Files          55       54       -1     
  Lines        2113     1768     -345     
  Branches      264      217      -47     
==========================================
- Hits         1352     1258      -94     
+ Misses        708      459     -249     
+ Partials       53       51       -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[anth-volk]

Please use "Fixes," not "Resolves," otherwise the script doesn't work

[SongmingFan123]

Please use "Fixes," not "Resolves," otherwise the script doesn't work

Fixed, thank you for the feedback.

[MaxGhenis]

Please test the prompt with Claude chat a few times and drop the results in a Google doc

[SongmingFan123]

This is the link to the file containing the tests:
https://docs.google.com/document/d/1zHrKCWRpzUg8_DzHN7XdJtWbk7Micp2cD20M0RLrZKc/edit?usp=sharing

Thank you.

[MaxGhenis]

Please show the full text result

[anth-volk]

Please use specifically "Fixes #ISSUE", the format you have won't correctly close the original issue. Check out the docs for more info.

If you set it up right, this panel on the right should indicate the issue being closed:

[SongmingFan123]

Please use specifically "Fixes #ISSUE", the format you have won't correctly close the original issue. Check out the docs for more info.

If you set it up right, this panel on the right should indicate the issue being closed:

Updated, thanks

[SongmingFan123]

Please show the full text result

Updated, thanks.

[anth-volk]

Also, please modify the changelog as we discussed post-meeting today to just include modifications to changelog_entry.yaml.

[MaxGhenis]

marking as requesting changes to receive sample results

[SongmingFan123]

marking as requesting changes to receive sample results

Could you specify what do you mean? Do you mean the references in the brackets?

[SongmingFan123]

Also, please modify the changelog as we discussed post-meeting today to just include modifications to changelog_entry.yaml.

Updated, thank you.

[MaxGhenis]

We avoided the upgrade because Claude 4 was adding things like FDR quotes. Please create a document of some sample LLM summaries to ensure our prompting avoids these issues.

[SongmingFan123]

We avoided the upgrade because Claude 4 was adding things like FDR quotes. Please create a document of some sample LLM summaries to ensure our prompting avoids these issues.

Updated, this is the link to the doc: https://docs.google.com/document/d/1ECOwIq2mX0CjWyxAYDevdX6vvIFKsbyibaItvPdKT_c/edit?usp=sharing
Thank you.

[anth-volk]

@SongmingFan123 if you could just remove the changes you made to CHANGELOG.md and changelog.yaml, we can merge.

[SongmingFan123]

@SongmingFan123 if you could just remove the changes you made to CHANGELOG.md and changelog.yaml, we can merge.

Fixed, thank you.

[SongmingFan123]

@SongmingFan123 if you could just remove the changes you made to CHANGELOG.md and changelog.yaml, we can merge.

Changes to the files have been made. Thank you.