Skip to content

Commit 70ad14c

Browse files
committed
OSDOCS-11692: Added a note for OVNK, NIC, JUMBO packets, MTU value
1 parent 1de0f04 commit 70ad14c

File tree

4 files changed

+20
-12
lines changed

4 files changed

+20
-12
lines changed

modules/ipsec-impact-networking.adoc

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,10 @@
22
//
33
// * scalability_and_performance/optimization/optimizing-networking.adoc
44

5+
:_mod-docs-content-type: CONCEPT
56
[id="ipsec-impact_{context}"]
67
= Impact of IPsec
78

89
Because encrypting and decrypting node hosts uses CPU power, performance is affected both in throughput and CPU usage on the nodes when encryption is enabled, regardless of the IP security system being used.
910

10-
IPSec encrypts traffic at the IP payload level, before it hits the NIC, protecting fields that would otherwise be used for NIC offloading. This means that some NIC acceleration features might not be usable when IPSec is enabled and will lead to decreased throughput and increased CPU usage.
11+
IPSec encrypts traffic at the IP payload level, before it hits the NIC, protecting fields that would otherwise be used for NIC offloading. This means that some NIC acceleration features might not be usable when IPSec is enabled and leads to decreased throughput and increased CPU usage.

modules/optimizing-mtu-networking.adoc

Lines changed: 9 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,11 +2,18 @@
22
//
33
// * scalability_and_performance/optimization/optimizing-networking.adoc
44

5+
:_mod-docs-content-type: CONCEPT
56
[id="optimizing-mtu_{context}"]
67
= Optimizing the MTU for your network
78

89
There are two important maximum transmission units (MTUs): the network interface controller (NIC) MTU and the cluster network MTU.
910

10-
The NIC MTU is configured at the time of {product-title} installation, and you can also change the cluster's MTU as a Day 2 operation. See "Changing cluster network MTU" for more information. The MTU must be less than or equal to the maximum supported value of the NIC of your network. If you are optimizing for throughput, choose the largest possible value. If you are optimizing for lowest latency, choose a lower value.
11+
The NIC MTU is configured at the time of {product-title} installation, and you can also change the MTU of a cluster as a postinstallation task. For more information, see "Changing cluster network MTU".
12+
13+
For a cluster that uses the OVN-Kubernetes plugin, the MTU must be less than `100` bytes to the maximum supported value of the NIC of your network. If you are optimizing for throughput, choose the largest possible value, such as `8900`. If you are optimizing for lowest latency, choose a lower value.
14+
15+
[IMPORTANT]
16+
====
17+
If your cluster uses the OVN-Kubernetes plugin and the network uses a NIC to send and receive unfragmented jumbo frame packets over the network, you must specify `9000` bytes as the MTU value for the NIC so that pods do not fail.
18+
====
1119

12-
For OVN and Geneve, the MTU must be less than the NIC MTU by 100 bytes at a minimum.

modules/recommended-install-practices.adoc

Lines changed: 5 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -2,12 +2,13 @@
22
//
33
// * scalability_and_performance/recommended-install-practices.adoc
44

5+
:_mod-docs-content-type: REFERENCE
56
[id="recommended-install-practices_{context}"]
67
= Recommended practices for installing large scale clusters
78

8-
When installing large clusters or scaling the cluster to larger node counts,
9-
set the cluster network `cidr` accordingly in your `install-config.yaml`
10-
file before you install the cluster:
9+
When installing large clusters or scaling the cluster to larger node counts, set the cluster network `cidr` accordingly in your `install-config.yaml` file before you install the cluster.
10+
11+
.Example `install-config.yaml` file with a network configuration for a cluster with a large node count
1112

1213
[source,yaml]
1314
----
@@ -22,6 +23,4 @@ networking:
2223
- 172.30.0.0/16
2324
----
2425

25-
The default cluster network `cidr` `10.128.0.0/14` cannot be used if the cluster
26-
size is more than 500 nodes. It must be set to `10.128.0.0/12` or
27-
`10.128.0.0/10` to get to larger node counts beyond 500 nodes.
26+
The default cluster network `cidr` `10.128.0.0/14` cannot be used if the cluster size is more than 500 nodes. The `cidr` must be set to `10.128.0.0/12` or `10.128.0.0/10` to get to larger node counts beyond 500 nodes.

scalability_and_performance/optimization/optimizing-networking.adoc

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,9 +10,7 @@ xref:../../networking/ovn_kubernetes_network_provider/about-ovn-kubernetes.adoc#
1010

1111
Geneve provides benefits over VLANs, such as an increase in networks from 4096 to over 16 million, and layer 2 connectivity across physical networks. This allows for all pods behind a service to communicate with each other, even if they are running on different systems.
1212

13-
Geneve encapsulates all tunneled traffic in user datagram protocol (UDP) packets. However, this leads to increased CPU utilization. Both these outer- and
14-
inner-packets are subject to normal checksumming rules to guarantee data is not corrupted during transit. Depending on CPU performance, this additional
15-
processing overhead can cause a reduction in throughput and increased latency when compared to traditional, non-overlay networks.
13+
Geneve encapsulates all tunneled traffic in user datagram protocol (UDP) packets. However, this leads to increased CPU utilization. Both these outer- and inner-packets are subject to normal checksumming rules to guarantee data is not corrupted during transit. Depending on CPU performance, this additional processing overhead can cause a reduction in throughput and increased latency when compared to traditional, non-overlay networks.
1614

1715
Cloud, VM, and bare metal CPU performance can be capable of handling much more than one Gbps network throughput. When using higher bandwidth links such as 10 or 40 Gbps, reduced performance can occur. This is a known issue in Geneve-based environments and is not specific to containers or {product-title}. Any network that relies on Geneve or VXLAN tunnels will perform similarly because of the tunnel implementation.
1816

@@ -23,15 +21,18 @@ If you are looking to push beyond one Gbps, you can:
2321
2422
Geneve-offload does not reduce latency. However, CPU utilization is reduced even in latency tests.
2523

24+
// Optimizing the MTU for your network
2625
include::modules/optimizing-mtu-networking.adoc[leveloffset=+1]
2726

2827
[role="_additional-resources"]
2928
.Additional resources
3029

3130
* xref:../../networking/changing-cluster-network-mtu.adoc#changing-cluster-network-mtu[Changing cluster network MTU]
3231
32+
// Recommended practices for installing large scale clusters
3333
include::modules/recommended-install-practices.adoc[leveloffset=+1]
3434

35+
// Impact of IPsec
3536
include::modules/ipsec-impact-networking.adoc[leveloffset=+1]
3637

3738
[role="_additional-resources"]

0 commit comments

Comments
 (0)