Skip to content

MigrationAssistant - Feature: Set desired count for proxies #10082

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 14 commits into from
Jul 8, 2025
Merged

MigrationAssistant - Feature: Set desired count for proxies #10082

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
c6230b3
MigrationAssistant - Feature: Set desired count for proxies
AndreKurait Jun 12, 2025
adec3bd
Apply suggestions from code review
Naarcha-AWS Jun 12, 2025
5c8bd76
Apply suggestions from code review
Naarcha-AWS Jun 13, 2025
abf06cb
Merge branch 'main' into CaputreProxyDesiredCount
Naarcha-AWS Jun 13, 2025
0ecda9f
Apply suggestions from code review
Naarcha-AWS Jun 13, 2025
08aa93d
Apply suggestions from code review
Naarcha-AWS Jun 27, 2025
a239d6c
Apply suggestions from code review
Naarcha-AWS Jun 30, 2025
e26a9b6
Update _migration-assistant/deploying-migration-assistant/configurati…
Naarcha-AWS Jul 2, 2025
d39ba85
Update example targetClusterProxyDesiredCount and captureProxyDesired…
AndreKurait Jul 8, 2025
a2984c6
Improve language on preventing failing deployments on capture/target …
AndreKurait Jul 8, 2025
1a5c546
Update _migration-assistant/deploying-migration-assistant/configurati…
AndreKurait Jul 8, 2025
dfd942e
Update _migration-assistant/deploying-migration-assistant/configurati…
AndreKurait Jul 8, 2025
5e6bc0e
Update _migration-assistant/deploying-migration-assistant/configurati…
AndreKurait Jul 8, 2025
0641445
Update _migration-assistant/deploying-migration-assistant/configurati…
AndreKurait Jul 8, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 15 additions & 4 deletions _migration-assistant/deploying-migration-assistant/configuration-options.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -97,11 +97,20 @@
"passwordFromSecretArn": <TARGET_CLUSTER_PASSWORD_SECRET>
}
},
"captureProxyServiceEnabled": true,
"captureProxyExtraArgs": "",

"// settingsForCaptureAndReplay": "Enable the below services for live traffic capture and replay",
"trafficReplayerServiceEnabled": true,
"trafficReplayerExtraArgs": "--speedup-factor 2.0",
"targetClusterProxyServiceEnabled": true

"// help trafficReplayerExtraArgs": "Increase speedup factor in order replay requests at a faster rate to catchup",
"trafficReplayerExtraArgs": "--speedup-factor 1.5",

"// help capture/target proxy pt. 1 of 2": "captureProxyService and targetClusterProxyService require networking access configured to successfully deploy,",
"// help capture/target proxy pt. 2 of 2": "consider deploying without first and enabling after ensuring cluster networking access on the migration console",
"captureProxyServiceEnabled": true,
"captureProxyDesiredCount": 3,
"targetClusterProxyServiceEnabled": true,
"targetClusterProxyDesiredCount": 3

}
}
```
Expand All @@ -114,9 +123,11 @@
| :--- | :--- | :--- |
| `captureProxyServiceEnabled` | `true` | Enables the Capture Proxy service deployment using an AWS CloudFormation stack. |
| `captureProxyExtraArgs` | `"--suppressCaptureForHeaderMatch user-agent .*elastic-java/7.17.0.*"` | Extra arguments for the Capture Proxy command, including options specified by the [Capture Proxy](https://github.com/opensearch-project/opensearch-migrations/blob/main/TrafficCapture/trafficCaptureProxyServer/src/main/java/org/opensearch/migrations/trafficcapture/proxyserver/CaptureProxy.java). |
| `captureProxyDesiredCount` | `3` | Set the number of capture proxy ecs tasks. In many cases it can be a good idea to keep this at 0 until after verifying connectivity with the source and target cluster in the migration console. After deploying the networking setup can be modified to allow ingress into existing cluster security groups by the migration security groups. |

Check failure on line 126 in _migration-assistant/deploying-migration-assistant/configuration-options.md

View workflow job for this annotation

GitHub Actions / style-job 

[vale] reported by reviewdog 🐶
[OpenSearch.Spelling] Error: ecs. If you are referencing a setting, variable, format, function, or repository, surround it with tic marks.

Raw Output:
{"message": "[OpenSearch.Spelling] Error: ecs. If you are referencing a setting, variable, format, function, or repository, surround it with tic marks.", "location": {"path": "_migration-assistant/deploying-migration-assistant/configuration-options.md", "range": {"start": {"line": 126, "column": 72}}}, "severity": "ERROR"}
| `trafficReplayerServiceEnabled` | `true` | Enables the Traffic Replayer service deployment using a CloudFormation stack. |
| `trafficReplayerExtraArgs` | `"--sigv4-auth-header-service-region es,us-east-1 --speedup-factor 5"` | Extra arguments for the Traffic Replayer command, including options for auth headers and other parameters specified by the [Traffic Replayer](https://github.com/opensearch-project/opensearch-migrations/blob/main/TrafficCapture/trafficReplayer/src/main/java/org/opensearch/migrations/replay/TrafficReplayer.java). |
| `targetClusterProxyServiceEnabled` | `true` | Enables the target cluster proxy service deployment using a CloudFormation stack. |
| `targetClusterProxyDesiredCount` | `3` | Set the number of target cluster proxy ecs tasks. In many cases it can be a good idea to keep this at 0 until after verifying connectivity with the source and target cluster in the migration console. After deploying the networking setup can be modified to allow ingress into existing cluster security groups by the migration security groups. |

Check failure on line 130 in _migration-assistant/deploying-migration-assistant/configuration-options.md

View workflow job for this annotation

GitHub Actions / style-job 

[vale] reported by reviewdog 🐶
[OpenSearch.Spelling] Error: ecs. If you are referencing a setting, variable, format, function, or repository, surround it with tic marks.

Raw Output:
{"message": "[OpenSearch.Spelling] Error: ecs. If you are referencing a setting, variable, format, function, or repository, surround it with tic marks.", "location": {"path": "_migration-assistant/deploying-migration-assistant/configuration-options.md", "range": {"start": {"line": 130, "column": 85}}}, "severity": "ERROR"}

For arguments available in `captureProxyExtraArgs`, see the `@Parameter` fields in [`CaptureProxy.java`](https://github.com/opensearch-project/opensearch-migrations/blob/main/TrafficCapture/trafficCaptureProxyServer/src/main/java/org/opensearch/migrations/trafficcapture/proxyserver/CaptureProxy.java). For `trafficReplayerExtraArgs`, see the `@Parameter` fields in [`TrafficReplayer.java`](https://github.com/opensearch-project/opensearch-migrations/blob/main/TrafficCapture/trafficReplayer/src/main/java/org/opensearch/migrations/replay/TrafficReplayer.java).

Expand Down
Loading