Skip to content

Improve get-rclone-config #313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Mar 17, 2025
Merged

Improve get-rclone-config #313

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
eba088b
Added support for config-name.# in get-rclone-config
arjunsuresh Mar 16, 2025
d9f24b0
Support write rclone config
arjunsuresh Mar 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions automation/script/module.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2593,6 +2593,7 @@ def _update_variation_tags_from_variations(
variation_name = self._get_name_for_dynamic_variation_tag(
variation_name)

# TODO: Move this to a function and apply it for combination of variations too
# base variations are automatically turned on. Only
# variations outside of any variation group can be added as
# a base_variation
Expand Down
19 changes: 16 additions & 3 deletions script/get-rclone-config/meta.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -8,18 +8,31 @@ tags:
- rclone-config
uid: 6c59ddbc6cd046e3
variations:
read-only:
group: permission
default: true
env:
MLC_RCLONE_DRIVE_SCOPE: drive.readonly
write:
group: permission
env:
MLC_RCLONE_DRIVE_SCOPE: drive
mlc-inference:
env:
MLC_RCLONE_CONFIG_CMD: 'rclone config create mlc-inference s3 provider=Cloudflare access_key_id=f65ba5eef400db161ea49967de89f47b secret_access_key=fbea333914c292b854f14d3fe232bad6c5407bf0ab1bebf78833c2b359bdfd2b endpoint=https://c2686074cb2caf5cbaf6d134bdba8b47.r2.cloudflarestorage.com'
mlperf-llama2:
env:
MLC_RCLONE_CONFIG_CMD: 'rclone config create mlc-llama2 drive config_is_local=false scope=drive.readonly root_folder_id=11tBZvvrh0FCm3XuR5E849K42TqftYdUF'
MLC_RCLONE_CONFIG_CMD: 'rclone config create mlc-llama2 drive config_is_local=false scope=<<<MLC_RCLONE_DRIVE_SCOPE>>> root_folder_id=11tBZvvrh0FCm3XuR5E849K42TqftYdUF'
MLC_RCLONE_CONNECT_CMD: 'rclone config reconnect mlc-llama2:'
mlperf-llama3-1:
env:
MLC_RCLONE_CONFIG_CMD: 'rclone config create mlc-llama3-1 drive config_is_local=false scope=drive.readonly root_folder_id=12K-2yvmr1ZSZ7SLrhidCbWc0BriN98am'
MLC_RCLONE_CONFIG_CMD: 'rclone config create mlc-llama3-1 drive config_is_local=false scope=<<<MLC_RCLONE_DRIVE_SCOPE>>> root_folder_id=12K-2yvmr1ZSZ7SLrhidCbWc0BriN98am'
MLC_RCLONE_CONNECT_CMD: 'rclone config reconnect mlc-llama3-1:'
waymo:
env:
MLC_RCLONE_CONFIG_CMD: 'rclone config create mlc-waymo drive config_is_local=false scope=drive.readonly root_folder_id=1xbfnaUurFeXliFFl1i1gj48eRU2NDiH5'
MLC_RCLONE_CONFIG_CMD: 'rclone config create mlc-waymo drive config_is_local=false scope=<<<MLC_RCLONE_DRIVE_SCOPE>>> root_folder_id=1xbfnaUurFeXliFFl1i1gj48eRU2NDiH5'
MLC_RCLONE_CONNECT_CMD: 'rclone config reconnect mlc-waymo:'
config-name.#:
env:
MLC_RCLONE_CONFIG_CMD: 'rclone config create # drive config_is_local=false scope=<<<MLC_RCLONE_DRIVE_SCOPE>>> root_folder_id=<<<MLC_RCLONE_DRIVE_FOLDER_ID>>>'
MLC_RCLONE_CONNECT_CMD: 'rclone config reconnect #:'
Loading