Skip to content

Modular Integration Test Framework with DeepSeek-v3 Support #1431

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 13 commits into
base: main
Choose a base branch
from

Conversation

wwwjn
Copy link
Contributor

@wwwjn wwwjn commented Jul 21, 2025

Integration Tests Restructuring

  • Split tests into two sets:

    1. Depth Test: Use llama3 model, to test all the main components of torchtitan are functioning as expected
    2. Breath Test: As we are supporting more models in torchtitan core, setup parallelsim related tests for each model, to test model architecture / args related changes. Make sure the Integration test implementation is easy to extend to new models.
  • Moved integration test files from the root directory to a dedicated tests/integration_tests/ directory

  • Added a base configuration file base_config.toml for integration tests, as most of the train_configs shared 90% same settings

  • Remove "use_for_integration_test" field in train configs. Change to by default using "debugmodel" flavor for integration tests.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Jul 21, 2025
@wwwjn wwwjn changed the title Integration Tests Restructuring for extensible test cases. Modular Integration Test Framework with DeepSeek-v3 Support Jul 21, 2025
@wwwjn wwwjn marked this pull request as draft July 21, 2025 20:15
@wwwjn wwwjn changed the title Modular Integration Test Framework with DeepSeek-v3 Support [WIP] Modular Integration Test Framework with DeepSeek-v3 Support Jul 25, 2025
@wwwjn wwwjn marked this pull request as ready for review July 25, 2025 22:22
@wwwjn wwwjn changed the title [WIP] Modular Integration Test Framework with DeepSeek-v3 Support Modular Integration Test Framework with DeepSeek-v3 Support Jul 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Meta Open Source bot.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant