CadolesKube
/
typhoon
mirror of https://github.com/puppetmaster/typhoon.git
7
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
typhoon/docs/topics/performance.md

43 lines
2.2 KiB
Markdown
Raw Normal View History

Add docs on provision time and network performance
2017-10-04 08:44:26 +02:00
# Performance
## Provision Time
Provisioning times vary based on the platform. Sampling the time to create (apply) and destroy clusters with 1 controller and 2 workers shows (roughly) what to expect.
| Platform | Apply | Destroy |
|---------------|-------|---------|
Promote AWS platform from alpha to beta
2017-11-07 06:19:11 +01:00
| AWS | 6 min | 5 min |
Add docs on provision time and network performance
2017-10-04 08:44:26 +02:00
| Bare-Metal | 10-14 min | NA |
digital-ocean: Run etcd cluster on-host, across controllers * Run etcd peers with TLS across controller nodes * Deprecate self-hosted-etcd on the Digital Ocean platform * Distribute etcd TLS certificates as part of initial provisioning * Check the status of etcd by running `systemctl status etcd-member`
2017-10-04 09:07:48 +02:00
| Digital Ocean | 3 min 30 sec | 20 sec |
Run etcd cluster on-host, across controllers on Google Cloud * Change controllers from a managed group to individual instances * Create discrete DNS records to each controller's private IP for etcd * Change etcd to run on-host, across controllers (etcd-member.service) * Reduce time to bootstrap a cluster * Deprecate self-hosted-etcd on the Google Cloud platform
2017-11-05 20:01:50 +01:00
| Google Cloud | 4 min | 4 min 30 sec |
Add docs on provision time and network performance
2017-10-04 08:44:26 +02:00
Notes:
Promote AWS platform from alpha to beta
2017-11-07 06:19:11 +01:00
* SOA TTL and NXDOMAIN caching can have a large impact on provision time
Add docs on provision time and network performance
2017-10-04 08:44:26 +02:00
* Platforms with auto-scaling take more time to provision (AWS, Google)
Promote AWS platform from alpha to beta
2017-11-07 06:19:11 +01:00
* Bare-metal POST times and network bandwidth will affect provision times
Add docs on provision time and network performance
2017-10-04 08:44:26 +02:00
## Network Performance
Promote AWS platform from alpha to beta
2017-11-07 06:19:11 +01:00
Network performance varies based on the platform and CNI plugin. `iperf` was used to measture the bandwidth between different hosts and different pods. Host-to-host shows typical bandwidth between host machines. Pod-to-pod shows the bandwidth between two `iperf` containers.
Add docs on provision time and network performance
2017-10-04 08:44:26 +02:00
| Platform / Plugin | Theory | Host to Host | Pod to Pod |
|----------------------------|-------:|-------------:|-------------:|
| AWS (flannel) | ? | 976 MB/s | 900-999 MB/s |
| AWS (calico, MTU 1480) | ? | 976 MB/s | 100-350 MB/s |
| AWS (calico, MTU 8991) | ? | 976 MB/s | 900-999 MB/s |
| Bare-Metal (flannel) | 1 GB/s | 934 MB/s | 903 MB/s |
| Bare-Metal (calico) | 1 GB/s | 941 MB/s | 931 MB/s |
Add performance benchmark for flannel with bonded NICs
2017-10-16 10:12:13 +02:00
| Bare-Metal (flannel, bond) | 3 GB/s | 2.3 GB/s | 1.17 GB/s |
Add docs on provision time and network performance
2017-10-04 08:44:26 +02:00
| Bare-Metal (calico, bond) | 3 GB/s | 2.3 GB/s | 1.17 GB/s |
| Digital Ocean | ? | 938 MB/s | 820-880 MB/s |
| Google Cloud (flannel) | ? | 1.94 GB/s | 1.76 GB/s |
| Google Cloud (calico) | ? | 1.94 GB/s | 1.81 GB/s |
Notes:
Promote AWS platform from alpha to beta
2017-11-07 06:19:11 +01:00
* Calico and Flannel have comparable performance. Platform and configuration differenes dominate.
* Neither CNI provider seems to be able to leverage bonded NICs (bare-metal)
* AWS and Digital Ocean network bandwidth fluctuates more than on other platforms.
Add docs on provision time and network performance
2017-10-04 08:44:26 +02:00
* Only [certain AWS EC2 instance types](http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/network_mtu.html#jumbo_frame_instances) allow jumbo frames. This is why the default MTU on AWS must be 1480.