2017-09-23 22:02:18 +02:00
# Typhoon
Notable changes between versions.
2018-08-13 01:44:13 +02:00
## Latest
2018-11-03 23:04:08 +01:00
* Change kube-apiserver `--kubelet-preferred-address-types` to InternalIP,ExternalIP,Hostname
2018-11-07 07:16:12 +01:00
#### Addons
* Update Prometheus from v2.4.3 to v2.5.0
2018-10-28 00:47:57 +02:00
## v1.12.2
* Kubernetes [v1.12.2 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.12.md#v1122 )
* Update CoreDNS from 1.2.2 to [1.2.4 ](https://github.com/coredns/coredns/releases/tag/v1.2.4 )
2018-10-24 05:30:30 +02:00
* Update Calico from v3.2.3 to [v3.3.0 ](https://docs.projectcalico.org/v3.3/releases/ )
2018-05-14 03:16:10 +02:00
* Disable Kubelet read-only port ([#324](https://github.com/poseidon/typhoon/pull/324))
2018-10-24 05:30:30 +02:00
* Fix CoreDNS AntiAffinity spec to prefer spreading replicas
2018-10-28 23:11:47 +01:00
* Ignore controller node user-data changes ([#335](https://github.com/poseidon/typhoon/pull/335))
* Once all managed clusters use v1.12.2, it is possible to update `terraform-provider-ct`
2018-10-18 07:19:57 +02:00
2018-10-15 16:59:35 +02:00
#### AWS
* Add `disk_iops` variable for EBS volume IOPS ([#314](https://github.com/poseidon/typhoon/pull/314))
2018-10-28 01:42:36 +02:00
#### Azure
2018-10-28 06:46:10 +01:00
* Use new `azurerm_network_interface_backend_address_pool_association` ([#332](https://github.com/poseidon/typhoon/pull/332))
* Require `terraform-provider-azurerm` v1.17+ (action required)
* Add `primary` field to `ip_configuration` needed by v1.17+ ([#331](https://github.com/poseidon/typhoon/pull/331))
2018-10-28 01:42:36 +02:00
2018-10-28 07:01:50 +01:00
#### DigitalOcean
* Add AAAA DNS records resolving to worker nodes ([#333](https://github.com/poseidon/typhoon/pull/333))
* Hosting IPv6 apps requires editing nginx-ingress with `hostNetwork: true`
2018-10-28 22:17:12 +01:00
#### Google Cloud
2018-10-28 23:11:47 +01:00
* Add an IPv6 address and IPv6 forwarding rules for load balancing IPv6 Ingress ([#334](https://github.com/poseidon/typhoon/pull/334))
2018-10-28 22:17:12 +01:00
* Add `ingress_static_ipv6` output variable for use in AAAA DNS records
* Allow serving IPv6 applications via Kubernetes Ingress
2018-10-19 05:39:30 +02:00
#### Addons
* Configure Heapster to scrape Kubelets with bearer token auth ([#323](https://github.com/poseidon/typhoon/pull/323))
2018-10-29 03:44:22 +01:00
* Update Grafana from v5.3.1 to v5.3.2
2018-10-19 05:39:30 +02:00
2018-10-17 17:53:23 +02:00
## v1.12.1
2018-09-22 09:02:37 +02:00
* Kubernetes [v1.12.1 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.12.md#v1121 )
2018-10-13 22:14:37 +02:00
* Update etcd from v3.3.9 to [v3.3.10 ](https://github.com/etcd-io/etcd/blob/master/CHANGELOG-3.3.md#v3310-2018-10-10 )
2018-10-17 17:53:23 +02:00
* Update CoreDNS from 1.1.3 to [1.2.2 ](https://github.com/coredns/coredns/releases/tag/v1.2.2 )
* Update Calico from v3.2.1 to [v3.2.3 ](https://docs.projectcalico.org/v3.2/releases/ )
* Raise scheduler and controller-manager replicas to the larger of 2 or the number of controller nodes ([#312](https://github.com/poseidon/typhoon/pull/312))
2018-10-13 22:16:18 +02:00
* Single-controller clusters continue to run 2 replicas as before
2018-10-17 17:53:23 +02:00
* Raise default CoreDNS replicas to the larger of 2 or the number of controller nodes ([#313](https://github.com/poseidon/typhoon/pull/313))
2018-10-14 01:21:22 +02:00
* Add AntiAffinity preferred rule to favor spreading CoreDNS pods
2018-10-17 17:53:23 +02:00
* Annotate control plane and addon containers to use the Docker runtime seccomp profile ([#319](https://github.com/poseidon/typhoon/pull/319))
* Override Kubernetes default behavior that starts containers with `seccomp=unconfined`
2018-10-02 16:06:41 +02:00
2018-10-14 06:55:46 +02:00
#### Azure
2018-10-17 17:53:23 +02:00
* Remove `admin_password` field (disabled) since it is now optional
2018-10-14 06:55:46 +02:00
* Require `terraform-provider-azurerm` v1.16+ (action required)
2018-10-15 11:27:32 +02:00
#### Bare-Metal
* Add support for `cached_install` mode with Flatcar Linux ([#315](https://github.com/poseidon/typhoon/pull/315))
2018-10-02 16:41:53 +02:00
#### DigitalOcean
2018-10-14 06:55:46 +02:00
* Require `terraform-provider-digitalocean` v1.0+ (action required)
2018-10-02 16:41:53 +02:00
2018-09-22 07:22:21 +02:00
#### Addons
2018-10-17 06:34:17 +02:00
* Update nginx-ingress from v0.19.0 to v0.20.0
2018-10-17 06:29:41 +02:00
* Update Prometheus from v2.3.2 to v2.4.3
2018-10-17 06:23:44 +02:00
* Update Grafana from v5.2.4 to v5.3.1
2018-09-22 07:22:21 +02:00
2018-09-14 03:48:07 +02:00
## v1.11.3
* Kubernetes [v1.11.3 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.11.md#v1113 )
2018-08-28 07:24:52 +02:00
* Introduce Typhoon for Azure as alpha ([#288](https://github.com/poseidon/typhoon/pull/288))
* Special thanks @justaugustus for an earlier variant
2018-08-15 08:49:33 +02:00
* Update Calico from v3.1.3 to v3.2.1 ([#278](https://github.com/poseidon/typhoon/pull/278))
2018-08-22 06:16:16 +02:00
#### AWS
2018-08-22 06:25:22 +02:00
* Remove firewall rule allowing ICMP packets to nodes ([#285](https://github.com/poseidon/typhoon/pull/285))
2018-08-22 06:16:16 +02:00
2018-08-13 01:44:13 +02:00
#### Bare-Metal
* Remove `controller_networkds` and `worker_networkds` variables. Use Container Linux Config snippets [#277 ](https://github.com/poseidon/typhoon/pull/277 )
2018-08-22 06:06:03 +02:00
#### Google Cloud
2018-08-22 08:21:05 +02:00
* Fix firewall to allow etcd client port 2379 traffic between controller nodes ([#287](https://github.com/poseidon/typhoon/pull/287))
* kube-apiservers were only able to connect to their node's local etcd peer. While master node outages were tolerated, reaching a healthy peer took longer than neccessary in some cases
* Reduce time needed to bootstrap the cluster
2018-08-22 06:25:22 +02:00
* Remove firewall rule allowing workers to access Nginx Ingress health check ([#284](https://github.com/poseidon/typhoon/pull/284))
2018-08-22 06:06:03 +02:00
* Nginx Ingress addon no longer uses hostNetwork, Prometheus scrapes via CNI network
2018-08-29 18:36:47 +02:00
#### Addons
2018-09-09 01:12:38 +02:00
* Update nginx-ingress from 0.17.1 to 0.19.0
2018-08-29 18:36:47 +02:00
* Update kube-state-metrics from v1.3.1 to v1.4.0
2018-09-09 00:41:20 +02:00
* Update Grafana from 5.2.2 to 5.2.4
2018-08-29 18:36:47 +02:00
2018-08-08 06:56:02 +02:00
## v1.11.2
2018-05-10 10:01:25 +02:00
2018-08-08 06:56:02 +02:00
* Kubernetes [v1.11.2 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.11.md#v1112 )
2018-07-29 20:27:37 +02:00
* Update etcd from v3.3.8 to [v3.3.9 ](https://github.com/coreos/etcd/blob/master/CHANGELOG-3.3.md#v339-2018-07-24 )
2018-07-29 20:20:17 +02:00
* Use kubernetes-incubator/bootkube v0.13.0
2018-07-29 21:13:29 +02:00
* Fix Fedora Atomic modules' Kubelet version ([#270](https://github.com/poseidon/typhoon/issues/270))
2018-07-29 20:20:17 +02:00
2018-07-26 07:44:07 +02:00
#### Bare-Metal
* Introduce [Container Linux Config snippets ](https://typhoon.psdn.io/advanced/customization/#container-linux ) on bare-metal
* Validate and additively merge custom Container Linux Configs during terraform plan
* Define files, systemd units, dropins, networkd configs, mounts, users, and more
2018-08-22 06:25:22 +02:00
* [Require ](https://typhoon.psdn.io/cl/bare-metal/#terraform-setup ) `terraform-provider-ct` plugin v0.2.1 (**action required!**)
2018-07-26 07:44:07 +02:00
2018-07-29 20:12:56 +02:00
#### Addons
2018-08-08 09:45:20 +02:00
* Update nginx-ingress from 0.16.2 to 0.17.1
2018-08-11 21:14:23 +02:00
* Add nginx-ingress manifests for bare-metal
2018-07-29 20:12:56 +02:00
* Update Grafana from 5.2.1 to 5.2.2
2018-07-29 20:15:47 +02:00
* Update heapster from v1.5.3 to v1.5.4
2018-07-29 20:12:56 +02:00
2018-07-26 07:44:07 +02:00
## v1.11.1
2018-07-20 09:36:58 +02:00
* Kubernetes [v1.11.1 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.11.md#v1111 )
2018-07-14 23:24:50 +02:00
#### Addons
* Update Prometheus from v2.3.1 to v2.3.2
2018-07-29 21:13:29 +02:00
#### Errata
* Fedora Atomic modules shipped with Kubelet v1.11.0, instead of v1.11.1. Fixed in [#270 ](https://github.com/poseidon/typhoon/issues/270 ).
2018-07-04 21:27:26 +02:00
## v1.11.0
2018-06-28 07:47:35 +02:00
* Kubernetes [v1.11.0 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.11.md#v1110 )
* Force apiserver to stop listening on `127.0.0.1:8080`
2018-07-02 04:41:57 +02:00
* Replace `kube-dns` with [CoreDNS ](https://coredns.io/ ) ([#261](https://github.com/poseidon/typhoon/pull/261))
* Edit the `coredns` ConfigMap to [customize ](https://coredns.io/plugins/ )
2018-07-04 21:27:26 +02:00
* CoreDNS doesn't use a resizer. For large clusters, scaling may be required.
2018-06-28 07:47:35 +02:00
2018-07-01 02:25:54 +02:00
#### AWS
* Update from Fedora Atomic 27 to 28 ([#258](https://github.com/poseidon/typhoon/pull/258))
2018-07-04 20:16:04 +02:00
#### Bare-Metal
* Update from Fedora Atomic 27 to 28 ([#263](https://github.com/poseidon/typhoon/pull/263))
2018-07-02 05:47:46 +02:00
#### Google
2018-07-02 07:49:33 +02:00
* Promote Google Cloud to stable
2018-07-01 03:12:36 +02:00
* Update from Fedora Atomic 27 to 28 ([#259](https://github.com/poseidon/typhoon/pull/259))
2018-07-02 05:47:46 +02:00
* Remove `ingress_static_ip` module output. Use `ingress_static_ipv4` .
* Remove `controllers_ipv4_public` module output.
2018-07-02 05:55:34 +02:00
#### Addons
2018-07-03 07:06:22 +02:00
* Update nginx-ingress from 0.15.0 to 0.16.2
2018-07-02 05:55:34 +02:00
* Update Grafana from 5.1.4 to [5.2.1 ](http://docs.grafana.org/guides/whats-new-in-v5-2/ )
2018-07-02 06:07:52 +02:00
* Update heapster from v1.5.2 to v1.5.3
2018-07-02 05:55:34 +02:00
2018-06-24 00:15:57 +02:00
## v1.10.5
2018-06-22 07:51:39 +02:00
* Kubernetes [v1.10.5 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.10.md#v1105 )
2018-06-20 06:55:05 +02:00
* Update etcd from v3.3.6 to v3.3.8 ([#243](https://github.com/poseidon/typhoon/pull/243), [#247 ](https://github.com/poseidon/typhoon/pull/247 ))
2018-06-15 07:43:01 +02:00
2018-06-19 06:57:58 +02:00
#### AWS
* Switch `kube-apiserver` port from 443 to 6443 ([#248](https://github.com/poseidon/typhoon/pull/248))
2018-06-19 07:56:32 +02:00
* Combine apiserver and ingress NLBs ([#249](https://github.com/poseidon/typhoon/pull/249))
2018-06-24 00:15:57 +02:00
* Reduce cost by ~$18/month per cluster. Typhoon AWS clusters now use one network load balancer.
* Ingress addon users may keep using CNAME records to the `ingress_dns_name` module output (few million RPS)
* Ingress users with heavy traffic (many million RPS) should create a separate NLB(s)
* Worker pools no longer include an extraneous load balancer. Remove worker module's `ingress_dns_name` output
2018-06-22 08:57:38 +02:00
* Disable detailed (paid) monitoring on worker nodes ([#251](https://github.com/poseidon/typhoon/pull/251))
2018-06-24 00:15:57 +02:00
* Favor Prometheus for cloud-agnostic metrics, aggregation, and alerting
* Add `worker_target_group_http` and `worker_target_group_https` module outputs to allow custom load balancing
* Add `target_group_http` and `target_group_https` worker module outputs to allow custom load balancing
2018-06-19 06:57:58 +02:00
2018-06-15 07:43:01 +02:00
#### Bare-Metal
2018-06-19 06:57:58 +02:00
* Switch `kube-apiserver` port from 443 to 6443 ([#248](https://github.com/poseidon/typhoon/pull/248))
* Users who exposed kube-apiserver on a WAN via their router/load-balancer will need to adjust its configuration (e.g. DNAT 6443). Most apiservers are on a LAN (internal, VPN-only, etc) so if you didn't specially configure network gear for 443, no change is needed. (possible action required)
2018-06-15 07:43:01 +02:00
* Fix possible deadlock when provisioning clusters larger than 10 nodes ([#244](https://github.com/poseidon/typhoon/pull/244))
2018-06-15 07:28:11 +02:00
2018-06-19 06:57:58 +02:00
#### DigitalOcean
* Switch `kube-apiserver` port from 443 to 6443 ([#248](https://github.com/poseidon/typhoon/pull/248))
* Update firewall rules and generated kubeconfig's
2018-05-07 08:21:53 +02:00
#### Google Cloud
* Use global HTTP and TCP proxy load balancing for Kubernetes Ingress ([#252](https://github.com/poseidon/typhoon/pull/252))
* Switch Ingress from regional network load balancers to global HTTP/TCP Proxy load balancing
* Reduce cost by ~$19/month per cluster. Google bills the first 5 global and regional forwarding rules separately. Typhoon clusters now use 3 global and 0 regional forwarding rules.
* Worker pools no longer include an extraneous load balancer. Remove worker module's `ingress_static_ip` output
2018-06-24 00:15:57 +02:00
* Allow using nginx-ingress addon on Fedora Atomic clusters ([#200](https://github.com/poseidon/typhoon/issues/200))
2018-05-07 08:21:53 +02:00
* Add `worker_instance_group` module output to allow custom global load balancing
2018-06-24 00:15:57 +02:00
* Add `instance_group` worker module output to allow custom global load balancing
* Deprecate `ingress_static_ip` module output. Add `ingress_static_ipv4` module output instead.
2018-05-07 08:21:53 +02:00
* Deprecate `controllers_ipv4_public` module output
2018-06-14 00:05:22 +02:00
#### Addons
* Update CLUO from v0.6.0 to v0.7.0 ([#242](https://github.com/poseidon/typhoon/pull/242))
2018-06-22 09:46:41 +02:00
* Update Prometheus from v2.3.0 to v2.3.1
* Update Grafana from 5.1.3 to 5.1.4
* Drop `hostNetwork` from nginx-ingress addon
* Both flannel and Calico support host port via `portmap`
* Allows writing NetworkPolicies that reference ingress pods in `from` or `to` . HostNetwork pods were difficult to write network policy for since they could circumvent the CNI network to communicate with pods on the same node.
2018-06-14 00:05:22 +02:00
2018-06-09 20:43:10 +02:00
## v1.10.4
2018-06-07 08:23:11 +02:00
* Kubernetes [v1.10.4 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.10.md#v1104 )
2018-06-07 08:18:37 +02:00
* Update etcd from v3.3.5 to v3.3.6
2018-05-31 06:31:12 +02:00
* Update Calico from v3.1.2 to v3.1.3
2018-05-31 07:33:16 +02:00
#### Addons
2018-06-22 09:46:41 +02:00
* Update Prometheus from v2.2.1 to v2.3.0
2018-05-31 07:33:16 +02:00
* Add Prometheus liveness and readiness probes
2018-05-31 07:37:47 +02:00
* Annotate Grafana service so Prometheus scrapes metrics
2018-06-09 20:44:21 +02:00
* Label namespaces to ease writing Network Policies
2018-05-31 07:33:16 +02:00
2018-05-22 05:41:34 +02:00
## v1.10.3
* Kubernetes [v1.10.3 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.10.md#v1103 )
2018-05-17 08:30:48 +02:00
* Add [Flatcar Linux ](https://docs.flatcar-linux.org/ ) (Container Linux derivative) as an option for AWS and bare-metal (thanks @kinvolk folks)
2018-05-14 08:49:45 +02:00
* Allow bearer token authentication to the Kubelet ([#216](https://github.com/poseidon/typhoon/issues/216))
2018-05-14 08:20:42 +02:00
* Require Webhook authorization to the Kubelet
* Switch apiserver X509 client cert org to satisfy new authorization requirement
2018-05-17 07:37:37 +02:00
* Require Terraform v0.11.x and drop support for v0.10.x ([migration guide](https://typhoon.psdn.io/topics/maintenance/#terraform-v011x))
* Update etcd from v3.3.4 to v3.3.5 ([#213](https://github.com/poseidon/typhoon/pull/213))
2018-05-22 05:41:34 +02:00
* Update Calico from v3.1.1 to v3.1.2
2018-05-10 10:01:25 +02:00
2018-04-29 22:19:00 +02:00
#### AWS
2018-05-17 08:30:48 +02:00
* Allow Flatcar Linux by setting `os_image` to flatcar-stable (default), flatcar-beta, flatcar-alpha ([#211](https://github.com/poseidon/typhoon/pull/211))
* Replace `os_channel` variable with `os_image` to align naming across clouds
* Please change values stable, beta, or alpha to coreos-stable, coreos-beta, coreos-alpha (**action required!**)
2018-05-09 07:38:05 +02:00
* Allow preemptible workers via spot instances ([#202](https://github.com/poseidon/typhoon/pull/202))
2018-05-17 08:30:48 +02:00
* Add `worker_price` to allow worker spot instances. Default to empty string for the worker autoscaling group to use regular on-demand instances
2018-04-29 22:19:00 +02:00
* Add `spot_price` to internal `workers` module for spot [worker pools ](https://typhoon.psdn.io/advanced/worker-pools/ )
2018-05-15 08:35:16 +02:00
#### Bare-Metal
2018-05-17 08:30:48 +02:00
* Allow Flatcar Linux by setting `os_channel` to flatcar-stable, flatcar-beta, flatcar-alpha ([#220](https://github.com/poseidon/typhoon/pull/220))
2018-05-17 07:37:37 +02:00
* Replace `container_linux_channel` variable with `os_channel`
2018-05-17 08:30:48 +02:00
* Please change values stable, beta, or alpha to coreos-stable, coreos-beta, coreos-alpha (**action required!**)
2018-05-17 07:37:37 +02:00
* Replace `container_linux_version` variable with `os_version`
2018-05-15 08:35:16 +02:00
* Add `network_ip_autodetection_method` variable for Calico host IPv4 address detection
* Use Calico's default "first-found" to support single NIC and bonded NIC nodes
2018-05-17 08:30:48 +02:00
* Allow [alternative ](https://docs.projectcalico.org/v3.1/reference/node/configuration#ip-autodetection-methods ) methods for multi NIC nodes, like can-reach=IP or interface=REGEX
2018-05-17 07:37:37 +02:00
* Deprecate `container_linux_oem` variable
2018-05-15 08:35:16 +02:00
2018-05-22 05:33:09 +02:00
#### DigitalOcean
* Update Fedora Atomic module to use Fedora Atomic 28 ([#225](https://github.com/poseidon/typhoon/pull/225))
* Fedora Atomic 27 images disappeared from DigitalOcean and forced this early update
2018-05-02 06:56:28 +02:00
#### Addons
* Fix Prometheus data directory location ([#203](https://github.com/poseidon/typhoon/pull/203))
2018-05-14 08:49:45 +02:00
* Configure Prometheus to scrape Kubelets directly with bearer token auth instead of proxying through the apiserver ([#217](https://github.com/poseidon/typhoon/pull/217))
* Security improvement: Drop RBAC permission from `nodes/proxy` to `nodes/metrics`
* Scale: Remove per-node proxied scrape load from the apiserver
2018-05-18 06:35:16 +02:00
* Update Grafana from v5.04 to v5.1.3 ([#208](https://github.com/poseidon/typhoon/pull/208))
2018-05-10 10:13:54 +02:00
* Disable Grafana Google Analytics by default ([#214](https://github.com/poseidon/typhoon/issues/214))
2018-05-18 06:42:55 +02:00
* Update nginx-ingress from 0.14.0 to 0.15.0
2018-05-19 22:05:50 +02:00
* Annotate nginx-ingress service so Prometheus auto-discovers and scrapes service endpoints ([#222](https://github.com/poseidon/typhoon/pull/222))
2018-05-02 06:56:28 +02:00
2018-04-29 22:19:00 +02:00
## v1.10.2
2017-10-04 09:07:48 +02:00
2018-04-28 09:03:29 +02:00
* Kubernetes [v1.10.2 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.10.md#v1102 )
2018-05-22 05:41:34 +02:00
* [Introduce ](https://typhoon.psdn.io/announce/#april-26-2018 ) Typhoon for Fedora Atomic ([#199](https://github.com/poseidon/typhoon/pull/199))
2018-04-22 00:13:38 +02:00
* Update Calico from v3.0.4 to v3.1.1 ([#197](https://github.com/poseidon/typhoon/pull/197))
* https://www.projectcalico.org/announcing-calico-v3-1/
* https://github.com/projectcalico/calico/releases/tag/v3.1.0
2018-04-28 08:57:26 +02:00
* Update etcd from v3.3.3 to v3.3.4
2018-04-29 21:04:44 +02:00
* Update kube-dns from v1.14.9 to v1.14.10
2018-04-22 00:13:38 +02:00
2018-04-15 09:50:43 +02:00
#### Google Cloud
* Add support for multi-controller clusters (i.e. multi-master) ([#54](https://github.com/poseidon/typhoon/issues/54), [#190 ](https://github.com/poseidon/typhoon/pull/190 ))
* Switch from Google Cloud network load balancer to a TCP proxy load balancer. Avoid a [bug ](https://issuetracker.google.com/issues/67366622 ) in Google network load balancers that limited clusters to only bootstrapping one controller node.
* Add TCP health check for apiserver pods on controllers. Replace kubelet check approximation.
2018-04-16 02:08:58 +02:00
#### Addons
2018-04-29 21:04:44 +02:00
* Update nginx-ingress from 0.12.0 to 0.14.0
2018-04-16 02:08:58 +02:00
* Update kube-state-metrics from v1.3.0 to v1.3.1
## v1.10.1
2018-04-13 05:23:35 +02:00
* Kubernetes [v1.10.1 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.10.md#v1101 )
2018-03-29 06:45:24 +02:00
* Enable etcd v3.3 metrics endpoint ([#175](https://github.com/poseidon/typhoon/pull/175))
2018-04-05 06:38:03 +02:00
* Use `k8s.gcr.io` instead of `gcr.io/google_containers` ([#180](https://github.com/poseidon/typhoon/pull/180))
2018-04-08 21:16:29 +02:00
* Kubernetes [recommends ](https://groups.google.com/forum/#!msg/kubernetes-dev/ytjk_rNrTa0/3EFUHvovCAAJ ) using the alias to pull from the nearest regional mirror and to abstract the backing container registry
2018-04-05 05:32:24 +02:00
* Update etcd from v3.3.2 to v3.3.3
2018-04-29 21:04:44 +02:00
* Update kube-dns from v1.14.8 to v1.14.9
2018-04-13 05:23:35 +02:00
* Use kubernetes-incubator/bootkube v0.12.0
2018-03-29 06:45:24 +02:00
2018-04-05 06:38:03 +02:00
#### Bare-Metal
* Fix need for multiple `terraform apply` runs to create a cluster with Terraform v0.11.4 ([#181](https://github.com/poseidon/typhoon/pull/181))
* To SSH during a disk install for debugging, SSH as user "core" with port 2222
* Remove the old trick of using a user "debug" during disk install
2018-04-12 08:19:35 +02:00
#### Google Cloud
* Refactor out the `controller` internal module
2018-03-29 06:45:24 +02:00
#### Addons
* Add Prometheus discovery for etcd peers on controller nodes ([#175](https://github.com/poseidon/typhoon/pull/175))
* Scrape etcd v3.3 `--listen-metrics-urls` for metrics
* Enable etcd alerts and populate the etcd Grafana dashboard
2018-04-05 06:04:13 +02:00
* Update kube-state-metrics from v1.2.0 to v1.3.0
2018-03-29 06:45:24 +02:00
## v1.10.0
2018-03-31 08:12:38 +02:00
* Kubernetes [v1.10.0 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.10.md#v1100 )
2018-03-26 06:56:55 +02:00
* Remove unused, unmaintained `pxe-worker` internal module
2018-03-29 09:24:07 +02:00
#### AWS
* Add `disk_type` optional variable for setting the EBS volume type ([#176](https://github.com/poseidon/typhoon/pull/176))
* Change default type from `standard` to `gp2` . Prometheus etcd alerts are tuned for fast disks.
2018-03-26 06:48:08 +02:00
#### Digital Ocean
2018-03-26 07:32:09 +02:00
* Ensure etcd secrets are only distributed to controller hosts, not workers.
2018-03-29 09:24:07 +02:00
* Remove `networking` optional variable. Only flannel works on Digital Ocean.
2018-03-26 06:48:08 +02:00
2018-03-26 07:04:14 +02:00
#### Google Cloud
2018-03-29 09:24:07 +02:00
* Add `disk_size` optional variable for setting instance disk size in GB
* Add `controller_type` optional variable for setting machine type for controllers
* Add `worker_type` optional variable for setting machine type for workers
* Remove `machine_type` optional variable. Use `controller_type` and `worker_type` .
2018-03-26 07:04:14 +02:00
2018-03-29 04:12:39 +02:00
#### Addons
* Update Grafana from v4.6.3 to v5.0.4 ([#153](https://github.com/poseidon/typhoon/pull/153), [#174 ](https://github.com/poseidon/typhoon/pull/174 ))
* Restrict dashboard organization role to Viewer
2018-03-23 05:56:29 +01:00
## v1.9.6
2018-03-22 04:29:52 +01:00
* Kubernetes [v1.9.6 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.9.md#v196 )
* Update Calico from v3.0.3 to v3.0.4
2018-03-22 04:32:01 +01:00
#### Addons
* Update heapster from v1.5.1 to v1.5.2
2018-03-20 07:15:57 +01:00
## v1.9.5
2018-03-19 01:50:14 +01:00
* Kubernetes [v1.9.5 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.9.md#v195 )
* Fix `subPath` volume mounts regression ([kubernetes#61076](https://github.com/kubernetes/kubernetes/issues/61076))
2018-03-19 07:52:59 +01:00
* Introduce [Container Linux Config snippets ](https://typhoon.psdn.io/advanced/customization/#container-linux ) on cloud platforms ([#145](https://github.com/poseidon/typhoon/pull/145))
* Validate and additively merge custom Container Linux Configs during `terraform plan`
* Define files, systemd units, dropins, networkd configs, mounts, users, and more
* Require updating `terraform-provider-ct` plugin from v0.2.0 to v0.2.1
2018-03-19 08:14:47 +01:00
* Add `node-role.kubernetes.io/controller="true"` node label to controllers ([#160](https://github.com/poseidon/typhoon/pull/160))
2018-03-19 07:52:59 +01:00
#### AWS
* [Require ](https://typhoon.psdn.io/topics/maintenance/#terraform-provider-ct-v021 ) updating `terraform-provider-ct` plugin from v0.2.0 to [v0.2.1 ](https://github.com/coreos/terraform-provider-ct/releases/tag/v0.2.1 ) (action required!)
#### Digital Ocean
* [Require ](https://typhoon.psdn.io/topics/maintenance/#terraform-provider-ct-v021 ) updating `terraform-provider-ct` plugin from v0.2.0 to [v0.2.1 ](https://github.com/coreos/terraform-provider-ct/releases/tag/v0.2.1 ) (action required!)
#### Google Cloud
* [Require ](https://typhoon.psdn.io/topics/maintenance/#terraform-provider-ct-v021 ) updating `terraform-provider-ct` plugin from v0.2.0 to [v0.2.1 ](https://github.com/coreos/terraform-provider-ct/releases/tag/v0.2.1 ) (action required!)
2018-03-19 08:06:37 +01:00
* Relax `os_image` to optional. Default to "coreos-stable".
2018-03-19 07:52:59 +01:00
2018-03-18 23:55:42 +01:00
#### Addons
2018-03-20 07:15:57 +01:00
* Update nginx-ingress from 0.11.0 to 0.12.0
2018-03-18 23:55:42 +01:00
* Update Prometheus from 2.2.0 to 2.2.1
2018-03-13 04:55:35 +01:00
## v1.9.4
2018-03-11 21:15:35 +01:00
* Kubernetes [v1.9.4 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.9.md#v194 )
2018-03-13 05:19:15 +01:00
* Secret, configMap, downward API, and projected volumes now read-only (breaking, [kubernetes#58720 ](https://github.com/kubernetes/kubernetes/pull/58720 ))
2018-03-15 02:54:22 +01:00
* Regressed `subPath` volume mounts (regression, [kubernetes#61076 ](https://github.com/kubernetes/kubernetes/issues/61076 ))
2018-03-13 05:19:15 +01:00
* Mitigated `subPath` [CVE-2017-1002101 ](https://github.com/kubernetes/kubernetes/issues/60813 )
2018-03-13 04:55:35 +01:00
* Introduce [worker pools ](https://typhoon.psdn.io/advanced/worker-pools/ ) for AWS and Google Cloud for joining heterogeneous workers to existing clusters.
2018-03-12 01:05:55 +01:00
* Use new Network Load Balancers and cross zone load balancing on AWS
2018-03-11 21:15:35 +01:00
* Allow flexvolume plugins to be used on any Typhoon cluster (not just bare-metal)
2018-03-09 09:43:15 +01:00
* Upgrade etcd from v3.2.15 to v3.3.2
2018-02-25 04:16:20 +01:00
* Update Calico from v3.0.2 to v3.0.3
2018-04-13 05:23:35 +02:00
* Use kubernetes-incubator/bootkube v0.11.0
2018-03-12 01:05:55 +01:00
* [Recommend ](https://typhoon.psdn.io/topics/maintenance/#terraform-provider-ct-v021 ) updating `terraform-provider-ct` plugin from v0.2.0 to [v0.2.1 ](https://github.com/coreos/terraform-provider-ct/releases/tag/v0.2.1 ) (action recommended)
2018-02-16 04:29:17 +01:00
2018-02-22 08:45:50 +01:00
#### AWS
2018-03-13 05:15:53 +01:00
* Promote AWS platform to stable
2018-03-12 01:05:55 +01:00
* Allow groups of workers to be defined and joined to a cluster (i.e. worker pools) ([#150](https://github.com/poseidon/typhoon/pull/150))
* Replace the apiserver elastic load balancer with a network load balancer ([#136](https://github.com/poseidon/typhoon/pull/136))
* Replace the Ingress elastic load balancer with a network load balancer ([#141](https://github.com/poseidon/typhoon/pull/141))
2018-02-26 21:55:32 +01:00
* AWS [NLBs ](https://aws.amazon.com/blogs/aws/new-network-load-balancer-effortless-scaling-to-millions-of-requests-per-second/ ) can handle millions of RPS with high throughput and low latency.
2018-03-12 01:05:55 +01:00
* Require `terraform-provider-aws` 1.7.0 or higher
2018-03-13 04:55:35 +01:00
* Enable NLB [cross-zone ](https://aws.amazon.com/about-aws/whats-new/2018/02/network-load-balancer-now-supports-cross-zone-load-balancing/ ) load balancing ([#159](https://github.com/poseidon/typhoon/pull/159))
* Requests are automatically evenly distributed to targets regardless of AZ
2018-03-12 01:05:55 +01:00
* Require `terraform-provider-aws` 1.11.0 or higher
2018-02-23 07:00:51 +01:00
* Add kubelet `--volume-plugin-dir` flag to allow flexvolume plugins ([#142](https://github.com/poseidon/typhoon/pull/142))
2018-03-10 22:13:48 +01:00
* Fix controller and worker launch configs to ignore AMI changes ([#126](https://github.com/poseidon/typhoon/pull/126), [#158 ](https://github.com/poseidon/typhoon/pull/158 ))
2018-02-23 07:00:51 +01:00
#### Digital Ocean
* Add kubelet `--volume-plugin-dir` flag to allow flexvolume plugins ([#142](https://github.com/poseidon/typhoon/pull/142))
2018-02-25 01:22:57 +01:00
* Fix to pass `ssh_fingerprints` as a list to droplets ([#143](https://github.com/poseidon/typhoon/pull/143))
2018-02-23 07:00:51 +01:00
#### Google Cloud
2018-02-27 07:16:34 +01:00
* Allow groups of workers to be defined and joined to a cluster (i.e. worker pools) ([#148](https://github.com/poseidon/typhoon/pull/148))
2018-02-23 07:00:51 +01:00
* Add kubelet `--volume-plugin-dir` flag to allow flexvolume plugins ([#142](https://github.com/poseidon/typhoon/pull/142))
2018-02-26 21:17:42 +01:00
* Add `kubeconfig` variable to `controllers` and `workers` submodules ([#147](https://github.com/poseidon/typhoon/pull/147))
* Remove `kubeconfig_*` variables from `controllers` and `workers` submodules ([#147](https://github.com/poseidon/typhoon/pull/147))
2018-03-03 02:26:51 +01:00
* Allow initial experimentation with accelerators (i.e. GPUs) on workers ([#161](https://github.com/poseidon/typhoon/pull/161)) (unofficial)
* Require `terraform-provider-google` v1.6.0
2018-02-11 19:45:39 +01:00
2018-02-23 07:33:13 +01:00
#### Addons
2018-03-03 06:59:19 +01:00
* Update Prometheus from 2.1.0 to 2.2.0 ([#153](https://github.com/poseidon/typhoon/pull/153))
2018-03-12 01:05:55 +01:00
* Scrape Prometheus itself to enable alerts about Prometheus itself
* Adjust KubeletDown rule to fire when 10% of kubelets are down
2018-02-23 07:33:13 +01:00
* Update heapster from v1.5.0 to v1.5.1 ([#131](https://github.com/poseidon/typhoon/pull/131))
* Use separate service account
* Update nginx-ingress from 0.10.2 to 0.11.0
2018-02-11 19:59:16 +01:00
## v1.9.3
2018-02-10 21:49:34 +01:00
* Kubernetes [v1.9.3 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.9.md#v193 )
2018-02-11 19:59:16 +01:00
* Network improvements and fixes ([#104](https://github.com/poseidon/typhoon/pull/104))
2018-02-10 21:49:34 +01:00
* Switch from Calico v2.6.6 to v3.0.2
* Add Calico GlobalNetworkSet CRD
2018-01-29 08:09:21 +01:00
* Update flannel from v0.9.0 to v0.10.0
2018-02-10 21:49:34 +01:00
* Use separate service account for flannel
2018-01-29 08:09:21 +01:00
* Update etcd from v3.2.14 to v3.2.15
2018-01-24 08:50:04 +01:00
2018-02-23 07:33:13 +01:00
#### Digital Ocean
* Use new Droplet [types ](https://developers.digitalocean.com/documentation/changelog/api-v2/new-size-slugs-for-droplet-plan-changes/ ) which offer more CPU/memory, at lower cost. ([#105](https://github.com/poseidon/typhoon/pull/105))
* A small Digital Ocean cluster costs less than $25 a month!
2018-01-28 10:24:27 +01:00
#### Addons
2018-02-11 19:59:16 +01:00
* Update Prometheus from v2.0.0 to v2.1.0 ([#113](https://github.com/poseidon/typhoon/pull/113))
2018-01-28 10:24:27 +01:00
* Improve alerting rules
* Relabel discovered kubelet, endpoint, service, and apiserver scrapes
* Use separate service accounts
* Update node-exporter and kube-state-metrics
2018-02-11 19:59:16 +01:00
* Include Grafana dashboards for Kubernetes admins ([#113](https://github.com/poseidon/typhoon/pull/113))
2018-01-28 10:24:27 +01:00
* Add grafana-watcher to load bundled upstream dashboards
* Update nginx-ingress from 0.9.0 to 0.10.2
2018-02-11 08:51:55 +01:00
* Update CLUO from v0.5.0 to v0.6.0
2018-02-11 19:59:16 +01:00
* Switch manifests to use `apps/v1` Deployments and Daemonsets ([#120](https://github.com/poseidon/typhoon/pull/120))
2018-02-11 19:19:09 +01:00
* Remove Kubernetes Dashboard manifests ([#121](https://github.com/poseidon/typhoon/pull/121))
2018-01-28 10:24:27 +01:00
2018-01-19 17:40:09 +01:00
## v1.9.2
* Kubernetes [v1.9.2 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.9.md#v192 )
2018-01-12 15:56:08 +01:00
* Add Terraform v0.11.x support
* Add explicit "providers" section to modules for Terraform v0.11.x
* Retain support for Terraform v0.10.4+
2018-02-26 21:55:32 +01:00
* Add [migration guide ](https://typhoon.psdn.io/topics/maintenance/#terraform-v011x ) from Terraform v0.10.x to v0.11.x (**action required!**)
2018-01-12 16:19:56 +01:00
* Update etcd from 3.2.13 to 3.2.14
2018-01-20 08:10:45 +01:00
* Update calico from 2.6.5 to 2.6.6
2018-01-12 17:12:18 +01:00
* Update kube-dns from v1.14.7 to v1.14.8
* Use separate service account for kube-dns
2018-01-20 08:10:45 +01:00
* Use kubernetes-incubator/bootkube v0.10.0
2018-01-12 16:19:56 +01:00
2018-01-14 21:36:40 +01:00
#### Bare-Metal
* Use per-node Container Linux install profiles ([#97](https://github.com/poseidon/typhoon/pull/97))
* Allow Container Linux channel/version to be chosen per-cluster
* Fix issue where cluster deletion could require `terraform apply` multiple times
2018-01-16 05:57:55 +01:00
#### Digital Ocean
* Relax `digitalocean` provider version constraint
2018-01-20 16:52:40 +01:00
* Fix bug with `terraform plan` always showing a firewall diff to be applied ([#3](https://github.com/poseidon/typhoon/issues/3))
2018-01-16 05:57:55 +01:00
2018-02-23 07:33:13 +01:00
#### Addons
* Update CLUO to v0.5.0 to fix compatibility with Kubernetes 1.9 (**important**)
* Earlier versions can't roll out Container Linux updates on Kubernetes 1.9 nodes ([cluo#163](https://github.com/coreos/container-linux-update-operator/issues/163))
* Update kube-state-metrics from v1.1.0 to v1.2.0
* Fix RBAC cluster role for kube-state-metrics
2018-01-12 16:19:56 +01:00
## v1.9.1
2017-12-21 23:06:38 +01:00
* Kubernetes [v1.9.1 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.9.md#v191 )
2018-01-09 16:03:04 +01:00
* Update kube-dns from 1.14.5 to v1.14.7
* Update etcd from 3.2.0 to 3.2.13
* Update Calico from v2.6.4 to v2.6.5
* Enable portmap to fix hostPort with Calico
2018-01-12 17:12:18 +01:00
* Use separate service account for controller-manager
2017-12-21 23:06:38 +01:00
2017-12-22 22:00:18 +01:00
## v1.8.6
2017-12-21 19:30:13 +01:00
* Kubernetes [v1.8.6 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.8.md#v186 )
2018-01-09 16:03:04 +01:00
* Update Calico from v2.6.3 to v2.6.4
2017-12-21 19:30:13 +01:00
2017-12-15 10:52:51 +01:00
## v1.8.5
2017-12-10 07:38:27 +01:00
* Kubernetes [v1.8.5 ](https://github.com/kubernetes/kubernetes/blob/master/CHANGELOG-1.8.md#v185 )
* Recommend Container Linux [images ](https://coreos.com/releases/ ) with Docker 17.09
2017-12-10 07:02:45 +01:00
* Container Linux stable, beta, and alpha now provide Docker 17.09 (instead
2017-12-15 10:52:51 +01:00
of 1.12)
* Older clusters (with CLUO addon) auto-update Container Linux version to begin using Docker 17.09
2017-12-10 07:38:27 +01:00
* Fix race where `etcd-member.service` could fail to resolve peers ([#69](https://github.com/poseidon/typhoon/pull/69))
2017-12-15 10:52:51 +01:00
* Add optional `cluster_domain_suffix` variable (#74)
2017-12-15 10:45:02 +01:00
* Use kubernetes-incubator/bootkube v0.9.1
2017-12-10 07:38:27 +01:00
#### Bare-Metal
* Add kubelet `--volume-plugin-dir` flag to allow flexvolume providers ([#61](https://github.com/poseidon/typhoon/pull/61))
#### Addons
2017-12-15 10:52:51 +01:00
* Discourage deploying the Kubernetes Dashboard (security)
2017-12-08 17:56:53 +01:00
2017-12-02 07:27:48 +01:00
## v1.8.4
2017-11-29 06:52:11 +01:00
* Kubernetes v1.8.4
* Calico related bug fixes
* Update Calico from v2.6.1 to v2.6.3
* Update flannel from v0.9.0 to v0.9.1
2017-12-02 07:27:48 +01:00
* Service accounts for kube-proxy and pod-checkpointer
* Use kubernetes-incubator/bootkube v0.9.0
2017-11-29 06:52:11 +01:00
2017-11-08 10:35:56 +01:00
## v1.8.3
2017-11-09 07:41:01 +01:00
* Kubernetes v1.8.3
2017-11-11 05:01:37 +01:00
* Run etcd on-host, across controllers
* Promote AWS platform to beta
* Use kubernetes-incubator/bootkube v0.8.2
2017-11-07 06:19:11 +01:00
2017-11-04 18:57:12 +01:00
#### Google Cloud
2017-11-04 19:48:50 +01:00
* Add required variable `region` (e.g. "us-central1")
2017-11-05 20:01:50 +01:00
* Reduce time to bootstrap a cluster
* Change etcd to run on-host, across controllers (etcd-member.service)
2017-11-05 20:09:03 +01:00
* Change controller instances to automatically span zones in the region
* Change worker managed instance group to automatically span zones in the region
2017-11-08 08:21:12 +01:00
* Improve internal firewall rules and use tag-based firewall policies
2017-11-05 20:01:50 +01:00
* Remove support for self-hosted etcd
2017-11-05 20:09:03 +01:00
* Remove the `zone` required variable
* Remove the `controller_preemptible` optional variable
2017-11-04 18:57:12 +01:00
2017-11-06 07:36:50 +01:00
#### AWS
2017-11-07 06:19:11 +01:00
* Promote AWS platform to beta
2017-11-06 07:36:50 +01:00
* Reduce time to bootstrap a cluster
* Change etcd to run on-host, across controllers (etcd-member.service)
2017-11-07 06:19:11 +01:00
* Fix firewall rules for multi-controller kubelet scraping and node-exporter
2017-11-06 07:36:50 +01:00
* Remove support for self-hosted etcd
2017-11-08 10:35:56 +01:00
#### Addons
* Add Prometheus 2.0 addon with alerting rules
* Add Grafana dashboard for observing metrics
2017-10-25 06:34:29 +02:00
## v1.8.2
* Kubernetes v1.8.2
* Fixes a memory leak in the v1.8.1 apiserver ([kubernetes#53485](https://github.com/kubernetes/kubernetes/issues/53485))
* Switch to using the `gcr.io/google_containers/hyperkube`
* Update flannel from v0.8.0 to v0.9.0
* Add `hairpinMode` to flannel CNI config
* Add `--no-negcache` to kube-dns dnsmasq
2017-10-28 21:50:37 +02:00
* Use kubernetes-incubator/bootkube v0.8.1
2017-10-25 06:34:29 +02:00
2017-10-09 08:49:29 +02:00
## v1.8.1
* Kubernetes v1.8.1
* Use kubernetes-incubator/bootkube v0.8.0
2017-10-04 09:07:48 +02:00
#### Digital Ocean
* Run etcd cluster across controller nodes (etcd-member.service)
* Remove support for self-hosted etcd
2017-10-09 08:49:29 +02:00
* Reduce time to bootstrap a cluster
2017-10-04 09:07:48 +02:00
2017-10-04 05:48:24 +02:00
## v1.7.7
* Kubernetes v1.7.7
* Use kubernetes-incubator/bootkube v0.7.0
* Update kube-dns to 1.14.5 to fix dnsmasq [vulnerability ](https://security.googleblog.com/2017/10/behind-masq-yet-more-dns-and-dhcp.html )
* Calico v2.6.1
* flannel-cni v0.3.0
* Update flannel CNI config to fix hostPort
2017-09-23 22:02:18 +02:00
## v1.7.5
* Kubernetes v1.7.5
2017-10-04 05:48:24 +02:00
* Use kubernetes-incubator/bootkube v0.6.2
2017-09-23 22:02:18 +02:00
* Add AWS Terraform module (alpha)
* Add support for Calico networking (bare-metal, Google Cloud, AWS)
* Change networking default from "flannel" to "calico"
#### AWS
* Add `network_mtu` to allow CNI interface MTU customization
#### Bare-Metal
* Add `network_mtu` to allow CNI interface MTU customization
2017-09-23 21:52:50 +02:00
* Remove support for `experimental_self_hosted_etcd`
2017-09-23 22:02:18 +02:00
## v1.7.3
* Kubernetes v1.7.3
2017-12-09 18:26:26 +01:00
* Use kubernetes-incubator/bootkube v0.6.1
2017-09-23 22:02:18 +02:00
#### Digital Ocean
* Add cloud firewall rules (requires Terraform v0.10)
* Change nodes tags from strings to DO tags
## v1.7.1
* Kubernetes v1.7.1
2017-12-09 18:26:26 +01:00
* Use kubernetes-incubator/bootkube v0.6.0
2017-09-23 22:02:18 +02:00
* Add Bare-Metal Terraform module (stable)
* Add Digital Ocean Terraform module (beta)
#### Google Cloud
* Remove `k8s_domain_name` variable, `cluster_name` + `dns_zone` resolves to controllers
* Rename `dns_base_zone` to `dns_zone`
* Rename `dns_base_zone_name` to `dns_zone_name`
## v1.6.7
* Kubernetes v1.6.7
2017-12-09 18:26:26 +01:00
* Use kubernetes-incubator/bootkube v0.5.1
2017-09-23 22:02:18 +02:00
## v1.6.6
* Kubernetes v1.6.6
2017-12-09 18:26:26 +01:00
* Use kubernetes-incubator/bootkube v0.4.5
2017-09-23 22:02:18 +02:00
* Disable locksmithd on hosts, in favor of [CLUO ](https://github.com/coreos/container-linux-update-operator ).
## v1.6.4
* Kubernetes v1.6.4
* Add Google Cloud Terraform module (stable)
## Earlier
Earlier versions, back to v1.3.0, used different designs and mechanisms.
