CadolesKube
/
typhoon
mirror of https://github.com/puppetmaster/typhoon.git
7
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
typhoon/docs/architecture/operating-systems.md

55 lines
2.4 KiB
Markdown
Raw Normal View History

Add architecture docs on operating systems
2018-04-24 10:10:40 +02:00
# Operating Systems
Upgrade docs packages and refresh content * Promote DigitalOcean from alpha to beta for Fedora CoreOS and Flatcar Linux * Upgrade mkdocs-material and PyPI packages for docs * Replace docs mentions of Container Linux with Flatcar Linux and move docs/cl to docs/flatcar-linux * Deprecate CoreOS Container Linux support. Its still usable for some time, but start removing docs
2020-05-21 07:53:51 +02:00
Typhoon supports [Fedora CoreOS](https://getfedora.org/coreos/) and [Flatcar Linux](https://www.flatcar-linux.org/). These operating systems were chosen because they offer:
Add architecture docs on operating systems
2018-04-24 10:10:40 +02:00
* Minimalism and focus on clustered operation
* Automated and atomic operating system upgrades
* Declarative and immutable configuration
* Optimization for containerized applications
Together, they diversify Typhoon to support a range of container technologies.
Add docs for Fedora CoreOS AWS and bare-metal
2019-07-18 08:52:34 +02:00
* Fedora CoreOS: rpm-ostree, podman, moby
Add Fedora CoreOS to issue template and docs * Update several Container Linux references to start referring to Flatcar Linux * Update docs and mentions of Fedora CoreOS
2020-03-25 08:31:18 +01:00
* Flatcar Linux: Gentoo core, rkt-fly, docker
Add architecture docs on operating systems
2018-04-24 10:10:40 +02:00
Add Fedora Atomic announcement and improve docs
2018-04-26 11:41:04 +02:00
## Host Properties
Add architecture docs on operating systems
2018-04-24 10:10:40 +02:00
Add Fedora CoreOS to issue template and docs * Update several Container Linux references to start referring to Flatcar Linux * Update docs and mentions of Fedora CoreOS
2020-03-25 08:31:18 +01:00
| Property | Flatcar Linux | Fedora CoreOS |
Update operating system notes in architecture docs
2021-12-10 02:21:24 +01:00
|-------------------|---------------|---------------|
| Kernel | ~5.10.x | ~5.14.x |
| systemd | 247 | 249 |
| Username | core | core |
Add docs for Fedora CoreOS AWS and bare-metal
2019-07-18 08:52:34 +02:00
| Ignition system | Ignition v2.x spec | Ignition v3.x spec |
Add Fedora CoreOS to issue template and docs * Update several Container Linux references to start referring to Flatcar Linux * Update docs and mentions of Fedora CoreOS
2020-03-25 08:31:18 +01:00
| storage driver | overlay2 (extfs) | overlay2 (xfs) |
Update operating system notes in architecture docs
2021-12-10 02:21:24 +01:00
| logging driver | json-file | journald |
| cgroup driver | systemd | systemd |
| cgroup version | v2 | v2 |
| Networking | systemd-networkd | NetworkManager |
| Resolver | systemd-resolved | systemd-resolved |
Add architecture docs on operating systems
2018-04-24 10:10:40 +02:00
Add Fedora Atomic announcement and improve docs
2018-04-26 11:41:04 +02:00
## Kubernetes Properties
Add Fedora CoreOS to issue template and docs * Update several Container Linux references to start referring to Flatcar Linux * Update docs and mentions of Fedora CoreOS
2020-03-25 08:31:18 +01:00
| Property | Flatcar Linux | Fedora CoreOS |
Update operating system notes in architecture docs
2021-12-10 02:21:24 +01:00
|-------------------|---------------|---------------|
Add Fedora Atomic announcement and improve docs
2018-04-26 11:41:04 +02:00
| single-master | all platforms | all platforms |
| multi-master | all platforms | all platforms |
Update CHANGES for control plane static pod switch * Remove old references to bootkube / self-hosted
2019-09-07 22:38:51 +02:00
| control plane | static pods | static pods |
Update operating system notes in architecture docs
2021-12-10 02:21:24 +01:00
| Container Runtime | docker 20.10 | docker 20.10 |
Switch from upstream hyperkube image to individual images * Kubernetes plans to stop releasing the hyperkube container image * Upstream will continue to publish `kube-apiserver`, `kube-controller-manager`, `kube-scheduler`, and `kube-proxy` container images to `k8s.gcr.io` * Upstream will publish Kubelet only as a binary for distros to package, either as a DEB/RPM on traditional distros or a container image on container-optimized operating systems * Typhoon will package the upstream Kubelet (checksummed) and its dependencies as a container image for use on CoreOS Container Linux, Flatcar Linux, and Fedora CoreOS * Update the Typhoon container image security policy to list `quay.io/poseidon/kubelet`as an official distributed artifact Hyperkube: https://github.com/kubernetes/kubernetes/pull/88676 Kubelet Container Image: https://github.com/poseidon/kubelet Kubelet Quay Repo: https://quay.io/repository/poseidon/kubelet
2020-03-17 05:21:41 +01:00
| kubelet image | kubelet [image](https://github.com/poseidon/kubelet) with upstream binary | kubelet [image](https://github.com/poseidon/kubelet) with upstream binary |
| control plane images | upstream images | upstream images |
Change Flatcar etcd-member.service container from rkt to docker * Use docker to run the `etcd-member.service` container * Use env-file `/etc/etcd/etcd.env` like podman on FCOS * Background: https://github.com/poseidon/typhoon/pull/855
2020-11-04 01:37:09 +01:00
| on-host etcd | docker | podman |
Change Flatcar kubelet.service container from rkt to docker * Use docker to run the `kubelet.service` container * Update Kubelet mounts to match Fedora CoreOS * Remove unused `/etc/ssl/certs` mount (see https://github.com/poseidon/typhoon/pull/810) * Remove unused `/usr/share/ca-certificates` mount * Remove `/etc/resolv.conf` mount, Docker default is ok * Change `delete-node.service` to use docker instead of rkt and inline ExecStart, as was done on Fedora CoreOS * Fix permission denied on shutdown `delete-node`, caused by the kubeconfig mount changing with the introduction of node TLS bootstrap Background * podmand, rkt, and runc daemonless container process runners provide advantages over the docker daemon for system containers. Docker requires workarounds for use in systemd units where the ExecStart must tail logs so systemd can monitor the daemonized container. https://github.com/moby/moby/issues/6791 * Why switch then? On Flatcar Linux, podman isn't shipped. rkt works, but isn't developing while container standards continue to move forward. Typhoon has used runc for the Kubelet runner before in Fedora Atomic, but its more low-level. So we're left with Docker, which is less than ideal, but shipped in Flatcar * Flatcar Linux appears to be shifting system components to use docker, which does provide some limited guards against breakages (e.g. Flatcar cannot enable docker live restore)
2020-10-19 07:51:25 +02:00
| on-host kubelet | docker | podman |
Add fleetlock docs and links to addons * Add links to fleetlock for Fedora CoreOS reboot coordination * https://github.com/poseidon/fleetlock
2020-08-28 08:25:44 +02:00
| CNI plugins | calico, cilium, flannel | calico, cilium, flannel |
| coordinated drain & OS update | [FLUO](https://github.com/kinvolk/flatcar-linux-update-operator) addon | [fleetlock](https://github.com/poseidon/fleetlock) |
Add Fedora Atomic announcement and improve docs
2018-04-26 11:41:04 +02:00
## Directory Locations
Add architecture docs on operating systems
2018-04-24 10:10:40 +02:00
Add Fedora Atomic announcement and improve docs
2018-04-26 11:41:04 +02:00
Typhoon conventional directories.
Add architecture docs on operating systems
2018-04-24 10:10:40 +02:00
| Kubelet setting | Host location |
|-------------------|--------------------------------|
Change CNI config directory to /etc/cni/net.d * Change CNI config directory from `/etc/kubernetes/cni/net.d` to `/etc/cni/net.d` (Kubelet default) * https://github.com/poseidon/terraform-render-bootstrap/pull/255
2021-04-02 08:45:19 +02:00
| cni-conf-dir | /etc/cni/net.d |
Add architecture docs on operating systems
2018-04-24 10:10:40 +02:00
| pod-manifest-path | /etc/kubernetes/manifests |
| volume-plugin-dir | /var/lib/kubelet/volumeplugins |