-
Notifications
You must be signed in to change notification settings - Fork 3k
Migrate towards using static output directories #1113
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
- Fixes load_config eagering resolving directories. Directories are only resolved when the output directories are local. - Add support for `--output` and `--reporting` flags for index CLI. To achieve previous output structure `index --output run1/artifacts --reports run1/reports`. - Use static output directories when initializing a new project. - Maintains backward compatibility for those using timestamp outputs locally.
Does this support using timestamp directories remotely? |
HI @nociza, we are migrating away from timestamp paths both remotely and locally. If you look at the v1-breaking-changes.md file in this PR it describes the change and migration. This PR still maintains support for timestamp paths locally for backwards compatibility but timestamp paths are not supported for remote storage. In issue #799 if you update your config to use static directories for storage then it should work though you may need to re-index or at least move your current index outputs to the new static location. |
* Migrate towards using static output directories - Fixes load_config eagering resolving directories. Directories are only resolved when the output directories are local. - Add support for `--output` and `--reporting` flags for index CLI. To achieve previous output structure `index --output run1/artifacts --reports run1/reports`. - Use static output directories when initializing a new project. - Maintains backward compatibility for those using timestamp outputs locally. * fix smoke tests * update query cli to work with static directories * remove eager path resolution from load_config. Support CLI overrides that can be resolved. * add docs and output logs/artifacts to same directory * use match statement * switch back to if statement --------- Co-authored-by: Alonso Guevara <alonsog@microsoft.com>
--output
and--reporting
flags for index CLI. To achieve previous output structureindex --output run1/artifacts --reports run1/reports
.Checklist