Kibana not showing data after images upgraded to 3.4
Environment
- OpenShift Container Platform 3.3 upgraded to 3.4
Issue
After upgrading OpenShift Container Platform and all the images, data is sent from Fluentd to Elasticsearch but it is not shown in Kibana.
However data coming from new projects created after the upgrade are displayed without problems.
Resolution
Run the logging-deployer-template in mode upgrade so that Kibana index patterns are updated to the new metadata schema
$ oc new-app logging-deployer-template --param MODE=upgrade
Another way to manually achieve this is by accessing Kibana UI -> "Settings" -> "Indices", select one of the affected indices and click the "Refresh field list" button. Once completed, data for this index pattern should be displayed.
Root Cause
After upgrading OpenShift to the latest version the new aggregated logging images might be used. The new images may include some changes that require the existing data to be updated and that is why the upgrade should always be performed after updating to a newer minor version as stated in the documentation:
OCP 3.4 - Manual Upgrading EFK logging stack
This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.