Eclipse Microprofile metrics causing slow startup and high cpu on EAP

Environment

• Red Hat Enterprise Application Platform (EAP) 7.3
• Eclipse Microprofile

Issue

• CPU really high at start up
• Prometheus and grafana are querying JBoss for metrics on deployed EJBs before JBoss has started.
• The following warnings in the JBoss server log:

<2020.07.06 12:03:58 157 -0400><Warn><hostname><management I/O-2><io.smallrye.metrics>Unable to export metric jboss_ejb3_passivated_count: java.lang.IllegalStateException: WFLYMETRICS0003: Unable to read attribute passivated-count on [
    ("deployment" => "LmgEJB.jar"),
    ("subsystem" => "ejb3"),
    ("stateful-session-bean" => "LmgEJB")
]: "WFLYCTL0379: System boot is in process; execution of remote management operations is not currently available".
	at org.wildfly.extension.microprofile.metrics.MetricCollector.readAttributeValue(MetricCollector.java:303)
	at org.wildfly.extension.microprofile.metrics.MetricCollector.access$200(MetricCollector.java:70)
	at org.wildfly.extension.microprofile.metrics.MetricCollector$2.getValue(MetricCollector.java:174)
	at org.wildfly.extension.microprofile.metrics.MetricCollector$2.getValue(MetricCollector.java:171)
	at io.smallrye.metrics.exporters.OpenMetricsExporter.createSimpleValueLine(OpenMetricsExporter.java:445)
	at io.smallrye.metrics.exporters.OpenMetricsExporter.exposeEntries(OpenMetricsExporter.java:178)
	at io.smallrye.metrics.exporters.OpenMetricsExporter.getEntriesForScope(OpenMetricsExporter.java:150)
	at io.smallrye.metrics.exporters.OpenMetricsExporter.exportAllScopes(OpenMetricsExporter.java:101)
	at io.smallrye.metrics.MetricsRequestHandler.handleRequest(MetricsRequestHandler.java:116)
	at io.smallrye.metrics.MetricsRequestHandler.handleRequest(MetricsRequestHandler.java:73)
	at org.wildfly.extension.microprofile.metrics.MetricsContextService$1.handleRequest(MetricsContextService.java:81)
	at org.jboss.as.domain.http.server.security.RealmReadinessHandler.handleRequest(RealmReadinessHandler.java:51)

Resolution

• Update to EAP 7.3.3+

Root Cause

This content is not included.This content is not included.https://issues.redhat.com/browse/JBEAP-19826

This solution is part of Red Hat’s fast-track publication program, providing a huge library of solutions that Red Hat engineers have created while supporting our customers. To give you the knowledge you need the instant it becomes available, these articles may be presented in a raw and unedited form.