Mounting separate disk for OpenShift 4 etcd
Environment
- Red Hat OpenShift Container Platform (RHOCP)
- 4
- etcd
Issue
- How to mount a separate disk for
etcdon OpenShift control plane nodes. - How to mount a separate disk for
/var/lib/etcdon OpenShift master nodes. - Due to bad etcd disk performance, a separate disk for
etcdis needed. - Following the recommendations in etcd backend performance requirements for OpenShift, it is needed to configure a separate disk for
etcdin our installed cluster. - There is a way to separate
/var/lib/containersto a different disk: Mounting separate disk for OpenShift 4 container storage. Is it possible to do the same with/var/lib/etcd? - Bad etcd performance.
Resolution
Starting with OpenShift 4.6, it is possible to configure an additional disk for etcd during the installation, following the documentation: Disk partitioning.
In recent versions of OpenShift 4, it is possible to move etcd to a different disk following the documentation:
- Moving etcd to a different disk in OpenShift 4.11.
- Moving etcd to a different disk in OpenShift 4.12+.
IMPORTANT NOTE: it is not supported to move etcd to a different disk following the documentation when using control plane machine sets (CPMS).
There is an internal RFE-479 to add the ability to configure a separate disk in IPI installations, and also RFE-5214 for creating additional data disk using MachineSet in Azure, but still not implemented.
Root Cause
Some of the most common issues with etcd are caused by slow storage. Separating the /var/lib/etcd to a different and faster disk could help resolving those issues.
For additional information about the etcd requirements, please review etcd backend performance requirements for OpenShift.
While this process can be used to mount additional disks to a RHEL CoreOS node, support is limited to no more than one additional disk/partition. Please see Understanding OpenShift File System Monitoring (eviction conditions) for more information.
This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.