From 7f8e781ae473e9375b0c23454a46c6a2f6127519 Mon Sep 17 00:00:00 2001 From: Dalton Hubble Date: Sun, 11 Nov 2018 21:05:07 -0800 Subject: [PATCH] Measure DigitalOcean network performance * Measuring pod-to-pod bandwidth in a few regions (NYC3, FRA1, SFO1) shows DigitalOcean has made some improvements --- CHANGES.md | 3 +-- docs/topics/performance.md | 22 +++++++++++----------- 2 files changed, 12 insertions(+), 13 deletions(-) diff --git a/CHANGES.md b/CHANGES.md index 1fa2672a..e4e02403 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -8,8 +8,7 @@ Notable changes between versions. * Update Calico from v3.3.0 to [v3.3.1](https://docs.projectcalico.org/v3.3/releases/) * Improve flannel manifests * [Rename](https://github.com/poseidon/terraform-render-bootkube/commit/d045a8e6b8eccfbb9d69bb51953b5a93d23f67f7) `kube-flannel` DaemonSet to `flannel` and `kube-flannel-cfg` ConfigMap to `flannel-config` - * Drop [unused](https://github.com/poseidon/terraform-render-bootkube/commit/39f9afb3360ec642e5b98457c8bd07eda35b6c96) container mounts - * Add a CPU resource request + * [Drop](https://github.com/poseidon/terraform-render-bootkube/commit/39f9afb3360ec642e5b98457c8bd07eda35b6c96) unused mounts and add a CPU resource request * Enable CoreDNS `loop` and `loadbalance` plugins ([#340](https://github.com/poseidon/typhoon/pull/340)) * Use kubernetes-incubator/bootkube v0.14.0 diff --git a/docs/topics/performance.md b/docs/topics/performance.md index 9f3bda7e..d6acf7bf 100644 --- a/docs/topics/performance.md +++ b/docs/topics/performance.md @@ -24,17 +24,17 @@ Network performance varies based on the platform and CNI plugin. `iperf` was use | Platform / Plugin | Theory | Host to Host | Pod to Pod | |----------------------------|-------:|-------------:|-------------:| -| AWS (flannel) | ? | 976 MB/s | 900-999 MB/s | -| AWS (calico, MTU 1480) | ? | 976 MB/s | 100-350 MB/s | -| AWS (calico, MTU 8981) | ? | 976 MB/s | 900-999 MB/s | -| Azure (flannel) | ? | 749 MB/s | 680 MB/s | -| Bare-Metal (flannel) | 1 GB/s | ~940 MB/s | 903 MB/s | -| Bare-Metal (calico) | 1 GB/s | ~940 MB/s | 931 MB/s | -| Bare-Metal (flannel, bond) | 3 GB/s | 2.3 GB/s | 1.17 GB/s | -| Bare-Metal (calico, bond) | 3 GB/s | 2.3 GB/s | 1.17 GB/s | -| Digital Ocean | ? | ~940 MB/s | 820-880 MB/s | -| Google Cloud (flannel) | ? | 1.94 GB/s | 1.76 GB/s | -| Google Cloud (calico) | ? | 1.94 GB/s | 1.81 GB/s | +| AWS (flannel) | Varies | 976 Mb/s | 900-999 Mb/s | +| AWS (calico, MTU 1480) | Varies | 976 Mb/s | 100-350 Mb/s | +| AWS (calico, MTU 8981) | Varies | 976 Mb/s | 900-999 Mb/s | +| Azure (flannel) | Varies | 749 Mb/s | 680 Mb/s | +| Bare-Metal (flannel) | 1 Gb/s | ~940 Mb/s | 903 Mb/s | +| Bare-Metal (calico) | 1 Gb/s | ~940 Mb/s | 931 Mb/s | +| Bare-Metal (flannel, bond) | 3 Gb/s | 2.3 Gb/s | 1.17 Gb/s | +| Bare-Metal (calico, bond) | 3 Gb/s | 2.3 Gb/s | 1.17 Gb/s | +| Digital Ocean | 2 Gb/s | 1.97 Gb/s | 1.64 Gb/s | +| Google Cloud (flannel) | 2 Gb/s | 1.94 Gb/s | 1.76 Gb/s | +| Google Cloud (calico) | 2 Gb/s | 1.94 Gb/s | 1.81 Gb/s | Notes: