typhoon/CHANGES.md

Typhoon

Notable changes between versions.

Latest

• Add worker pools for AWS and Google Cloud (advanced)
• Recommend updating terraform-provider-ct plugin from v0.2.0 to v0.2.1 (action recommended)
• Upgrade etcd from v3.2.15 to v3.3.1
• Update Calico from v3.0.2 to v3.0.3
• Use kubernetes-incubator/bootkube v0.10.0

AWS

• Switch apiserver elastic load balancer to a network load balancer (#136)
• Switch Ingress elastic load balancer to a network load balancer (#141)
  • AWS NLBs can handle millions of RPS with high throughput and low latency.
  • Require terraform-provider-aws 1.7.0 or higher
• Allow groups of workers to be defined and joined to a cluster (i.e. worker pools) (#150)
• Add kubelet --volume-plugin-dir flag to allow flexvolume plugins (#142)

Digital Ocean

• Add kubelet --volume-plugin-dir flag to allow flexvolume plugins (#142)
• Fix to pass ssh_fingerprints as a list to droplets (#143)

Google Cloud

• Allow groups of workers to be defined and joined to a cluster (i.e. worker pools) (#148)
• Add kubelet --volume-plugin-dir flag to allow flexvolume plugins (#142)
• Add kubeconfig variable to controllers and workers submodules (#147)
• Remove kubeconfig_* variables from controllers and workers submodules (#147)

Addons

• Update Prometheus from 2.1.0 to 2.2.0 (#153)
• Update Grafana from v4.6.3 to v5.0.0 (#153)
• Update heapster from v1.5.0 to v1.5.1 (#131)
  • Use separate service account
• Update nginx-ingress from 0.10.2 to 0.11.0

v1.9.3

• Kubernetes v1.9.3
• Network improvements and fixes (#104)
  • Switch from Calico v2.6.6 to v3.0.2
  • Add Calico GlobalNetworkSet CRD
  • Update flannel from v0.9.0 to v0.10.0
  • Use separate service account for flannel
• Update etcd from v3.2.14 to v3.2.15

Digital Ocean

• Use new Droplet types which offer more CPU/memory, at lower cost. (#105)
  • A small Digital Ocean cluster costs less than $25 a month!

Addons

• Update Prometheus from v2.0.0 to v2.1.0 (#113)
  • Improve alerting rules
  • Relabel discovered kubelet, endpoint, service, and apiserver scrapes
  • Use separate service accounts
  • Update node-exporter and kube-state-metrics
• Include Grafana dashboards for Kubernetes admins (#113)
  • Add grafana-watcher to load bundled upstream dashboards
• Update nginx-ingress from 0.9.0 to 0.10.2
• Update CLUO from v0.5.0 to v0.6.0
• Switch manifests to use apps/v1 Deployments and Daemonsets (#120)
• Remove Kubernetes Dashboard manifests (#121)

v1.9.2

• Kubernetes v1.9.2
• Add Terraform v0.11.x support
  • Add explicit "providers" section to modules for Terraform v0.11.x
  • Retain support for Terraform v0.10.4+
• Add migration guide from Terraform v0.10.x to v0.11.x (action required!)
• Update etcd from 3.2.13 to 3.2.14
• Update calico from 2.6.5 to 2.6.6
• Update kube-dns from v1.14.7 to v1.14.8
• Use separate service account for kube-dns
• Use kubernetes-incubator/bootkube v0.10.0

Bare-Metal

• Use per-node Container Linux install profiles (#97)
  • Allow Container Linux channel/version to be chosen per-cluster
  • Fix issue where cluster deletion could require terraform apply multiple times

Digital Ocean

• Relax digitalocean provider version constraint
• Fix bug with terraform plan always showing a firewall diff to be applied (#3)

Addons

• Update CLUO to v0.5.0 to fix compatibility with Kubernetes 1.9 (important)
  • Earlier versions can't roll out Container Linux updates on Kubernetes 1.9 nodes (cluo#163)
• Update kube-state-metrics from v1.1.0 to v1.2.0
• Fix RBAC cluster role for kube-state-metrics

v1.9.1

• Kubernetes v1.9.1
• Update kube-dns from 1.14.5 to v1.14.7
• Update etcd from 3.2.0 to 3.2.13
• Update Calico from v2.6.4 to v2.6.5
• Enable portmap to fix hostPort with Calico
• Use separate service account for controller-manager

v1.8.6

• Kubernetes v1.8.6
• Update Calico from v2.6.3 to v2.6.4

v1.8.5

• Kubernetes v1.8.5
• Recommend Container Linux images with Docker 17.09
  • Container Linux stable, beta, and alpha now provide Docker 17.09 (instead of 1.12)
  • Older clusters (with CLUO addon) auto-update Container Linux version to begin using Docker 17.09
• Fix race where etcd-member.service could fail to resolve peers (#69)
• Add optional cluster_domain_suffix variable (#74)
• Use kubernetes-incubator/bootkube v0.9.1

Bare-Metal

• Add kubelet --volume-plugin-dir flag to allow flexvolume providers (#61)

Addons

• Discourage deploying the Kubernetes Dashboard (security)

v1.8.4

• Kubernetes v1.8.4
• Calico related bug fixes
• Update Calico from v2.6.1 to v2.6.3
• Update flannel from v0.9.0 to v0.9.1
• Service accounts for kube-proxy and pod-checkpointer
• Use kubernetes-incubator/bootkube v0.9.0

v1.8.3

• Kubernetes v1.8.3
• Run etcd on-host, across controllers
• Promote AWS platform to beta
• Use kubernetes-incubator/bootkube v0.8.2

Google Cloud

• Add required variable region (e.g. "us-central1")
• Reduce time to bootstrap a cluster
• Change etcd to run on-host, across controllers (etcd-member.service)
• Change controller instances to automatically span zones in the region
• Change worker managed instance group to automatically span zones in the region
• Improve internal firewall rules and use tag-based firewall policies
• Remove support for self-hosted etcd
• Remove the zone required variable
• Remove the controller_preemptible optional variable

AWS

• Promote AWS platform to beta
• Reduce time to bootstrap a cluster
• Change etcd to run on-host, across controllers (etcd-member.service)
• Fix firewall rules for multi-controller kubelet scraping and node-exporter
• Remove support for self-hosted etcd

Addons

• Add Prometheus 2.0 addon with alerting rules
• Add Grafana dashboard for observing metrics

v1.8.2

• Kubernetes v1.8.2
  • Fixes a memory leak in the v1.8.1 apiserver (kubernetes#53485)
• Switch to using the gcr.io/google_containers/hyperkube
• Update flannel from v0.8.0 to v0.9.0
• Add hairpinMode to flannel CNI config
• Add --no-negcache to kube-dns dnsmasq
• Use kubernetes-incubator/bootkube v0.8.1

v1.8.1

• Kubernetes v1.8.1
• Use kubernetes-incubator/bootkube v0.8.0

Digital Ocean

• Run etcd cluster across controller nodes (etcd-member.service)
• Remove support for self-hosted etcd
• Reduce time to bootstrap a cluster

v1.7.7

• Kubernetes v1.7.7
• Use kubernetes-incubator/bootkube v0.7.0
• Update kube-dns to 1.14.5 to fix dnsmasq vulnerability
• Calico v2.6.1
• flannel-cni v0.3.0
  • Update flannel CNI config to fix hostPort

v1.7.5

• Kubernetes v1.7.5
• Use kubernetes-incubator/bootkube v0.6.2
• Add AWS Terraform module (alpha)
• Add support for Calico networking (bare-metal, Google Cloud, AWS)
• Change networking default from "flannel" to "calico"

AWS

• Add network_mtu to allow CNI interface MTU customization

Bare-Metal

• Add network_mtu to allow CNI interface MTU customization
• Remove support for experimental_self_hosted_etcd

v1.7.3

• Kubernetes v1.7.3
• Use kubernetes-incubator/bootkube v0.6.1

Digital Ocean

• Add cloud firewall rules (requires Terraform v0.10)
• Change nodes tags from strings to DO tags

v1.7.1

• Kubernetes v1.7.1
• Use kubernetes-incubator/bootkube v0.6.0
• Add Bare-Metal Terraform module (stable)
• Add Digital Ocean Terraform module (beta)

Google Cloud

• Remove k8s_domain_name variable, cluster_name + dns_zone resolves to controllers
• Rename dns_base_zone to dns_zone
• Rename dns_base_zone_name to dns_zone_name

v1.6.7

• Kubernetes v1.6.7
• Use kubernetes-incubator/bootkube v0.5.1

v1.6.6

• Kubernetes v1.6.6
• Use kubernetes-incubator/bootkube v0.4.5
• Disable locksmithd on hosts, in favor of CLUO.

v1.6.4

• Kubernetes v1.6.4
• Add Google Cloud Terraform module (stable)

Earlier

Earlier versions, back to v1.3.0, used different designs and mechanisms.