OpenShift 4.x Troubleshooting Quick Reference

Updated

This article is not meant to be a clone of the Content from kubernetes.io is not included.kubernetes cheat sheet. You should use this in conjunction with that cheat sheet, however, you are likely to find this document more concise.

Hosts

You will use these commands on a host, in the cluster often on a master. To run them you will need SSH access to the host, and root (sudo) permissions.

  • If you have a functioning api you can get system logs via a shim

    $ oc adm node-logs --role=<master|worker> -u <systemd_unit>
$ oc adm node-logs --role=master --path=<path_under_/var/log>

  • Note: All commands listed require ssh access to the host.

        $ grep OSTREE_VERSION /etc/os-release
    $ rpm-ostree version

    $ sudo journalctl -b -f -ukubelet.service -u crio.service
    $ sudo crictl pods 
    $ sudo crictl logs <pod> 
    $ sudo tail -f /var/log/containers/*

  • Commands below, are only relevant at install time (on the bootstrap host) 

    $ sudo journalctl -b -f -u bootkube.service 
$ sudo podman logs <pod>
$ sudo tail -f /var/lib/containers/storage/overlay-containers/*/userdata/ctr.log

General Cluster Health and Version Information

These commands can be run from anywhere, so long as you have oc (and in some cases using kubectl may work), provided you have permissions on the cluster to read the data you are requesting.

  • Use oc adm must-gather to collect information about the state of your cluster.
    • This command (and all oc adm commands) requires admin privileges to run. 
$ oc get clusterversion
$ oc get clusteroperators
$ oc adm release info $(oc get clusterversion -o jsonpath='{.items[].status.current.payload}{"\n"}')

Applications

These commands can be run from anywhere, so long as you have oc (and in some cases using kubectl may work), provided you have permissions on the cluster to read the data you are requesting. 

$ oc api-resources --verbs=list --namespaced -o name 
$ oc get deployments,daemonsets,pods,configmaps,services  -n <namespace> -o yaml
$ oc describe <object> -n <namespace> 
$ oc logs <pod> -n <namespace>

$ oc get --insecure-skip-tls-verify --server=https://localhost:<port> --raw=/version
$ oc get --insecure-skip-tls-verify --server=https://localhost:<port> --raw=/healthz
$ oc get --insecure-skip-tls-verify --server=https://localhost:<port> --raw=/metrics
SBR
Product(s)
Category
Tags
Article Type