Skip to content

Commit 350c409

Browse files
authored
Merge pull request #77956 from stevsmit/limited-live-migration-updates
Swaps live migration to limited live migration
2 parents 0c8f663 + 06c8920 commit 350c409

8 files changed

+45
-45
lines changed

modules/how-the-live-migration-process-works.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,7 +39,7 @@ Cluster Network Operator (CNO)::
3939
* Triggers the Machine Config Operator (MCO) to apply the new machine config to each machine config pool, which includes node cordoning, draining, and rebooting.
4040
* OVN-Kubernetes adds nodes to the appropriate zones and recreates pods using OVN-Kubernetes as the default CNI plugin.
4141
* Removes migration-related fields from the network.operator CR and performs cleanup actions, such as deleting OpenShift SDN resources and redeploying OVN-Kubernetes in normal mode with the necessary configurations.
42-
* Waits for the OVN-Kubernetes redeployment and updates the status conditions in the `network.config` CR to indicate migration completion. If your migration is blocked, see "Checking live migration metrics" for information on troubleshooting the issue.
42+
* Waits for the OVN-Kubernetes redeployment and updates the status conditions in the `network.config` CR to indicate migration completion. If your migration is blocked, see "Checking limited live migration metrics" for information on troubleshooting the issue.
4343
--
4444
|===
4545

modules/live-migration-metrics-information.adoc

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -4,29 +4,29 @@
44

55
:_mod-docs-content-type: PROCEDURE
66
[id="live-migration-metrics-information"]
7-
= Information about live migration metrics
7+
= Information about limited live migration metrics
88

99
The following table shows you the available metrics and the label values populated from the `openshift_network_operator_live_migration_procedure` expression. Use this information to monitor progress or to troubleshoot the migration.
1010

1111

12-
.Live migration metrics
12+
.Limited live migration metrics
1313
[cols="1a,1a",options="header"]
1414
|===
1515
| Metric | Label values
1616
|
1717
*`openshift_network_operator_live_migration_blocked:`*::
1818
+
1919
--
20-
A Prometheus gauge vector metric. A metric that contains a constant `1` value labeled with the reason that the CNI live migration might not have started. This metric is available when the CNI live migration has started by annotating the `Network` custom resource. +
21-
This metric is not published unless the live migration is blocked.
20+
A Prometheus gauge vector metric. A metric that contains a constant `1` value labeled with the reason that the CNI limited live migration might not have started. This metric is available when the CNI limited live migration has started by annotating the `Network` custom resource. +
21+
This metric is not published unless the limited live migration is blocked.
2222
--
2323
|
2424
The list of label values includes the following::
2525
+
2626
--
2727
* `UnsupportedCNI`: Unable to migrate to the unsupported target CNI. Valid CNI is `OVNKubernetes` when migrating from OpenShift SDN.
28-
* `UnsupportedHyperShiftCluster`: Live migration is unsupported within an HCP cluster.
29-
* `UnsupportedSDNNetworkIsolationMode`: OpenShift SDN is configured with an unsupported network isolation mode `Multitenant`. Migrate to a supported network isolation mode before performing live migration.
28+
* `UnsupportedHyperShiftCluster`: Limited live migration is unsupported within an HCP cluster.
29+
* `UnsupportedSDNNetworkIsolationMode`: OpenShift SDN is configured with an unsupported network isolation mode `Multitenant`. Migrate to a supported network isolation mode before performing limited live migration.
3030
* `UnsupportedMACVLANInterface`: Remove the egress router or any pods which contain the pod annotation `pod.network.openshift.io/assign-macvlan`.
3131
Find the offending pod's namespace or pod name with the following command: +
3232
+
@@ -37,9 +37,9 @@ Find the offending pod's namespace or pod name with the following command: +
3737
*`openshift_network_operator_live_migration_condition:`*::
3838
+
3939
--
40-
A metric which represents the status of each condition type for the CNI live migration. The set of status condition types is defined for `network.config` to support observability of the CNI live migration. +
41-
A `1` value represents condition status `true`. A `0` value represents `false`. `-1` represents unknown. This metric is available when the CNI live migration has started by annotating the `Network` custom resource (CR). +
42-
This metric is only available when the live migration has been triggered by adding the relevant annotation to the `Network` CR cluster, otherwise, it is not published. If the following condition types are not present within the Network CR cluster, the metric and their labels are cleared.
40+
A metric which represents the status of each condition type for the CNI limited live migration. The set of status condition types is defined for `network.config` to support observability of the CNI limited live migration. +
41+
A `1` value represents condition status `true`. A `0` value represents `false`. `-1` represents unknown. This metric is available when the CNI limited live migration has started by annotating the `Network` custom resource (CR). +
42+
This metric is only available when the limited live migration has been triggered by adding the relevant annotation to the `Network` CR cluster, otherwise, it is not published. If the following condition types are not present within the Network CR cluster, the metric and their labels are cleared.
4343
--
4444
|
4545
The list of label values includes the following::

modules/nw-ovn-kubernetes-checking-live-migration-metrics.adoc

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -4,17 +4,17 @@
44

55
:_mod-docs-content-type: PROCEDURE
66
[id="checking-live-migration-metrics"]
7-
= Checking live migration metrics
7+
= Checking limited live migration metrics
88

9-
Metrics are available to monitor the progress of the live migration. Metrics can be viewed on the {product-title} web console, or by using the `oc` CLI.
9+
Metrics are available to monitor the progress of the limited live migration. Metrics can be viewed on the {product-title} web console, or by using the `oc` CLI.
1010

1111
.Prerequisites
1212

13-
* You have initiated a live migration to OVN-Kubernetes.
13+
* You have initiated a limited live migration to OVN-Kubernetes.
1414
1515
.Procedure
1616

17-
. To view live migration metrics on the {product-title} web console:
17+
. To view limited live migration metrics on the {product-title} web console:
1818

1919
.. Click *Observe* -> *Metrics*.
2020

@@ -72,4 +72,4 @@ $ oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -k -H "
7272
...
7373
----
7474

75-
The table in "Information about live migration metrics" shows you the available metrics and the label values populated from the `openshift_network_operator_live_migration_procedure` expression. Use this information to monitor progress or to troubleshoot the migration.
75+
The table in "Information about limited live migration metrics" shows you the available metrics and the label values populated from the `openshift_network_operator_live_migration_procedure` expression. Use this information to monitor progress or to troubleshoot the migration.

modules/nw-ovn-kubernetes-live-migration-about.adoc

Lines changed: 18 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -3,30 +3,30 @@
33
// * networking/ovn_kubernetes_network_provider/migrate-from-openshift-sdn.adoc
44

55
[id="nw-ovn-kubernetes-live-migration-about_{context}"]
6-
= Live migration to the OVN-Kubernetes network plugin overview
6+
= Limited live migration to the OVN-Kubernetes network plugin overview
77

8-
The live migration method is the process in which the OpenShift SDN network plugin and its network configurations, connections, and associated resources, are migrated to the OVN-Kubernetes network plugin without service interruption. It is available for {product-title}, {product-dedicated}, {product-rosa}, and Azure Red Hat OpenShift deployment types. It is not available for HyperShift deployment types. This migration method is valuable for deployment types that require constant service availability and offers the following benefits:
8+
The limited live migration method is the process in which the OpenShift SDN network plugin and its network configurations, connections, and associated resources, are migrated to the OVN-Kubernetes network plugin without service interruption. It is available for {product-title}, {product-dedicated}, {product-rosa}, and Azure Red Hat OpenShift deployment types. It is not available for HyperShift deployment types. This migration method is valuable for deployment types that require constant service availability and offers the following benefits:
99

1010
* Continuous service availability
1111
* Minimized downtime
1212
* Automatic node rebooting
1313
* Seamless transition from the OpenShift SDN network plugin to the OVN-Kubernetes network plugin
1414

15-
Although a rollback procedure is provided, the live migration is intended to be a one-way process.
15+
Although a rollback procedure is provided, the limited live migration is intended to be a one-way process.
1616

1717
include::snippets/sdn-deprecation-statement.adoc[]
1818

19-
The following sections provide more information about the live migration method.
19+
The following sections provide more information about the limited live migration method.
2020

2121
[id="supported-platforms-live-migrating-ovn-kubernetes"]
22-
== Supported platforms when using the live migration method
22+
== Supported platforms when using the limited live migration method
2323

24-
The following table provides information about the supported platforms for the live migration type.
24+
The following table provides information about the supported platforms for the limited live migration type.
2525

26-
.Supported platforms for the live migration method
26+
.Supported platforms for the limited live migration method
2727
[cols="1,1", options="header"]
2828
|===
29-
| Platform | Live Migration
29+
| Platform | Limited Live Migration
3030

3131
| Bare metal hardware (IPI and UPI) |✓
3232
| Amazon Web Services (AWS) (IPI and UPI) |✓
@@ -40,29 +40,29 @@ The following table provides information about the supported platforms for the l
4040
|===
4141

4242
[id="considerations-live-migrating-ovn-kubernetes-network-provider_{context}"]
43-
== Considerations for live migration to the OVN-Kubernetes network plugin
43+
== Considerations for limited live migration to the OVN-Kubernetes network plugin
4444

45-
Before using the live migration method to the OVN-Kubernetes network plugin, cluster administrators should consider the following information:
45+
Before using the limited live migration method to the OVN-Kubernetes network plugin, cluster administrators should consider the following information:
4646

47-
* The live migration procedure is unsupported for clusters with OpenShift SDN multitenant mode enabled.
47+
* The limited live migration procedure is unsupported for clusters with OpenShift SDN multitenant mode enabled.
4848

49-
* Egress router pods block the live migration process. They must be removed before beginning the live migration process.
49+
* Egress router pods block the limited live migration process. They must be removed before beginning the limited live migration process.
5050

51-
* During the live migration, multicast, egress IP addresses, and egress firewalls are temporarily disabled. They can be migrated from OpenShift SDN to OVN-Kubernetes after the live migration process has finished.
51+
* During the limited live migration, multicast, egress IP addresses, and egress firewalls are temporarily disabled. They can be migrated from OpenShift SDN to OVN-Kubernetes after the limited live migration process has finished.
5252

5353
* The migration is intended to be a one-way process. However, for users that want to rollback to OpenShift-SDN, migration from OpenShift-SDN to OVN-Kubernetes must have succeeded. Users can follow the same procedure below to migrate to the OpenShift SDN network plugin from the OVN-Kubernetes network plugin.
5454

55-
* The live migration is not supported on HyperShift clusters.
55+
* The limited live migration is not supported on HyperShift clusters.
5656

5757
* OpenShift SDN does not support IPsec. After the migration, cluster administrators can enable IPsec.
5858

5959
* OpenShift SDN does not support IPv6. After the migration, cluster administrators can enable dual-stack.
6060

6161
* The cluster MTU is the MTU value for pod interfaces. It is always less than your hardware MTU to account for the cluster network overlay overhead. The overhead is 100 bytes for OVN-Kubernetes and 50 bytes for OpenShift SDN.
6262
+
63-
During the live migration, both OVN-Kubernetes and OpenShift SDN run in parallel. OVN-Kubernetes manages the cluster network of some nodes, while OpenShift SDN manages the cluster network of others. To ensure that cross-CNI traffic remains functional, the Cluster Network Operator updates the routable MTU to ensure that both CNIs share the same overlay MTU. As a result, after the migration has completed, the cluster MTU is 50 bytes less.
63+
During the limited live migration, both OVN-Kubernetes and OpenShift SDN run in parallel. OVN-Kubernetes manages the cluster network of some nodes, while OpenShift SDN manages the cluster network of others. To ensure that cross-CNI traffic remains functional, the Cluster Network Operator updates the routable MTU to ensure that both CNIs share the same overlay MTU. As a result, after the migration has completed, the cluster MTU is 50 bytes less.
6464

65-
* Some parameters of OVN-Kubernetes cannot be changed after installation. The following parameters can be set only before starting the live migration:
65+
* Some parameters of OVN-Kubernetes cannot be changed after installation. The following parameters can be set only before starting the limited live migration:
6666

6767
** `InternalTransitSwitchSubnet`
6868
** `internalJoinSubnet`
@@ -81,8 +81,8 @@ $ oc patch network.operator.openshift.io cluster --type='merge' -p='{"spec":{"de
8181
$ oc patch network.operator.openshift.io cluster --type='merge' -p='{"spec":{"defaultNetwork":{"ovnKubernetesConfig":{"ipv4":{"internalTransitSwitchSubnet": "100.99.0.0/16"}}}}}'
8282
----
8383

84-
* In most cases, the live migration is independent of the secondary interfaces of pods created by the Multus CNI plugin. However, if these secondary interfaces were set up on the default network interface controller (NIC) of the host, for example, using MACVLAN, IPVLAN, SR-IOV, or bridge interfaces with the default NIC as the control node, OVN-Kubernetes might encounter malfunctions. Users should remove such configurations before proceeding with the live migration.
84+
* In most cases, the limited live migration is independent of the secondary interfaces of pods created by the Multus CNI plugin. However, if these secondary interfaces were set up on the default network interface controller (NIC) of the host, for example, using MACVLAN, IPVLAN, SR-IOV, or bridge interfaces with the default NIC as the control node, OVN-Kubernetes might encounter malfunctions. Users should remove such configurations before proceeding with the limited live migration.
8585

8686
* When there are multiple NICs inside of the host, and the default route is not on the interface that has the Kubernetes NodeIP, you must use the offline migration instead.
8787

88-
* All `DaemonSet` objects in the `openshift-sdn` namespace, which are not managed by the Cluster Network Operator (CNO), must be removed before initiating the live migration. These unmanaged daemon sets can cause the migration status to remain incomplete if not properly handled.
88+
* All `DaemonSet` objects in the `openshift-sdn` namespace, which are not managed by the Cluster Network Operator (CNO), must be removed before initiating the limited live migration. These unmanaged daemon sets can cause the migration status to remain incomplete if not properly handled.

modules/nw-ovn-kubernetes-live-migration.adoc

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -5,9 +5,9 @@
55

66
:_mod-docs-content-type: PROCEDURE
77
[id="nw-ovn-kubernetes-live-migration_{context}"]
8-
= Migrating to the OVN-Kubernetes network plugin by using the live migration method
8+
= Migrating to the OVN-Kubernetes network plugin by using the limited live migration method
99

10-
The following procedure checks for egress router resources and uses the live migration method to migrate from the OpenShift SDN network plugin to the OVN-Kubernetes network plugin.
10+
The following procedure checks for egress router resources and uses the limited live migration method to migrate from the OpenShift SDN network plugin to the OVN-Kubernetes network plugin.
1111

1212
.Prerequisites
1313

@@ -17,12 +17,12 @@ The following procedure checks for egress router resources and uses the live mig
1717
* You have created a recent backup of the etcd database.
1818
* The cluster is in a known good state without any errors.
1919
* Before migration to OVN-Kubernetes, a security group rule must be in place to allow UDP packets on port `6081` for all nodes on all cloud platforms.
20-
* Cluster administrators must remove any egress router pods before beginning the live migration. For more information about egress router pods, see "Deploying an egress router pod in redirect mode".
21-
* You have reviewed the "Considerations for live migration to the OVN-Kubernetes network plugin" section of this document.
20+
* Cluster administrators must remove any egress router pods before beginning the limited live migration. For more information about egress router pods, see "Deploying an egress router pod in redirect mode".
21+
* You have reviewed the "Considerations for limited live migration to the OVN-Kubernetes network plugin" section of this document.
2222
2323
.Procedure
2424

25-
. Before initiating the live migration, you must check for any egress router pods. If there is an egress router pod on the cluster when performing a live migration, the Network Operator blocks the migration and returns the following error:
25+
. Before initiating the limited live migration, you must check for any egress router pods. If there is an egress router pod on the cluster when performing a limited live migration, the Network Operator blocks the migration and returns the following error:
2626
+
2727
[source,text]
2828
----
@@ -46,7 +46,7 @@ $ oc get pods --all-namespaces -o json | jq '.items[] | select(.metadata.annotat
4646
}
4747
----
4848
+
49-
** Alternatively, you can query metrics on the {product-title} web console or by using the `oc` CLI to check for egress router pods. For more information, see "Checking live migration metrics".
49+
** Alternatively, you can query metrics on the {product-title} web console or by using the `oc` CLI to check for egress router pods. For more information, see "Checking limited live migration metrics".
5050

5151
. Enter the following command to remove an egress router pod:
5252
+
@@ -85,7 +85,7 @@ $ oc get network.config.openshift.io cluster -o jsonpath='{.status.networkType}'
8585
$ oc get network.config cluster -o=jsonpath='{.status.conditions}' | jq .
8686
----
8787
+
88-
You can check live migration metrics for troubleshooting issues. For more information, see "Checking live migration metrics".
88+
You can check limited live migration metrics for troubleshooting issues. For more information, see "Checking limited live migration metrics".
8989

9090
. Complete the following steps only if the migration succeeds and your cluster is in a good state:
9191

modules/nw-ovn-kubernetes-rollback-live.adoc

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,9 +4,9 @@
44

55
:_mod-docs-content-type: PROCEDURE
66
[id="nw-ovn-kubernetes-rollback-live_{context}"]
7-
= Using the live migration method to roll back to the OpenShift SDN network plugin
7+
= Using the limited live migration method to roll back to the OpenShift SDN network plugin
88

9-
As a cluster administrator, you can roll back to the OpenShift SDN Container Network Interface (CNI) network plugin by using the live migration method. During the migration with this method, nodes are automatically rebooted and service to the cluster is not interrupted.
9+
As a cluster administrator, you can roll back to the OpenShift SDN Container Network Interface (CNI) network plugin by using the limited live migration method. During the migration with this method, nodes are automatically rebooted and service to the cluster is not interrupted.
1010

1111
[IMPORTANT]
1212
====

networking/ovn_kubernetes_network_provider/migrate-from-openshift-sdn.adoc

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ include::_attributes/common-attributes.adoc[]
66

77
toc::[]
88

9-
As a cluster administrator, you can migrate to the OVN-Kubernetes network plugin from the OpenShift SDN network plugin using the _offline_ migration method or the _live_ migration method.
9+
As a cluster administrator, you can migrate to the OVN-Kubernetes network plugin from the OpenShift SDN network plugin using the _offline_ migration method or the limited live migration method.
1010

1111
To learn more about OVN-Kubernetes, read xref:../../networking/ovn_kubernetes_network_provider/about-ovn-kubernetes#about-ovn-kubernetes[About the OVN-Kubernetes network plugin].
1212

0 commit comments

Comments
 (0)