Pacemaker does not manage the `ceph-nfs` resource correctly during RHOSP and RHCS upgrade

Environment

• Red Hat Openstack Platform (RHOSP) 17.1
• Red Hat Ceph Storage (RHCS) 5

Issue

During the upgrade from RHOSP 16.2 to 17.1, when RHCS is upgraded from 4 to 5, the overcloud upgrade fails because because containers that are associated with ceph-nfs-pacemaker are down, impacting the Shared File Systems service (manila).

Resolution

Apply the following workaround to address the issue:

Before running the overcloud upgrade prepare command, create a new manila-cephfs-ganesha-ceph-ansible-config.yaml file to point to the heat ceph-ansible resource that manages the current ceph-nfs instance.

1. Add the following content to the manila-cephfs-ganesha-ceph-ansible-config.yaml file:

   # A heat environment file that can be used to enable a
   # manila CephFS-NFS driver back end when Ceph is configured
   # by ceph-ansible
   resource_registry:
     OS::TripleO::Services::CephNfs: /usr/share/openstack-tripleo-heat- 
   templates/deployment/ceph-ansible/ceph-nfs.yaml
   

2. Add the generated file at the end of the overcloud upgrade prepare script with the following syntax:

   openstack overcloud upgrade prepare
   …
   -e /path/to/manila-cephfs-ganesha-ceph-ansible-config.yaml
   …
   

3. Run the overcloud upgrade prepare script, and continue with the Ceph Storage upgrade.

4. When the Ceph Storage upgrade is complete and the adoption process is complete, remove the environment file from the overcloud upgrade prepare script. At this point, ceph-ansible is removed from the deployment and cephadm is used in its place.

Root Cause

During the RHOSP and RHCS upgrade, Pacemaker does not manage the ceph-nfs resource correctly because it is misconfigured. The overcloud upgrade fails because containers that are associated with ceph-nfs-pacemaker cannot be found, impacting the Shared File Systems service (manila).

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.