Deployment Limits for Red Hat OpenStack Platform

Updated

These limits for Red Hat OpenStack Platform components can be used to help design and scale OpenStack deployments. For more information on configuration options, see Recommended Practices for OpenStack, and the OpenStack documentation.

Table of Contents

  1. Networking service (Neutron)
  2. Compute service (Nova)
  3. Image service (Glance)
  4. Orchestration service / Template (Heat)
  5. Block Storage service (Cinder)
  6. Identity service (Keystone)

Networking service (Neutron)

AreaMaximum LimitNotes
Number of logical networks in the environment using VLAN4,094This is the number of unique networks when using VLANs (12-bit VID in 802.1q).
Number of logical networks in the environment using NVGRE / VXLAN16,000,000This is the number of unique networks when using NVGRE (24-bit TNI) or VXLAN (24-bit VNI).
Number of logical networks per compute node4,094This assumes that you are using the ML2/Open vSwitch plugin. OVS 'br-int' uses local VLANs to separate traffic on the node.
Number of logical networks served by a network node4,094This assumes that you are using the ML2/Open vSwitch plugin. OVS 'br-int' uses local VLANs to separate traffic on the node.
Number of external networksTopology-dependentThe maximum limit is the sum of the logical networks served by a network node or compute node, if OpenStack is set as a provider network on the compute node.
Number of routed networksUnlimited
Number of HA routers255 per tenantThe number of HA routers per tenant is capped to 255 due to the VRRP protocol. Also, there is a limit on the maximum number of HA routers across all tenants based on the memory available on the overcloud controllers as each HA router created, spawns a neutron-keepalived-state-change process which consumes 85M of RSS memory.
Number of gatewaysUnlimitedSome versions of Open vSwitch limit the number of namespaces to 1,000. This can impact the number of gateways.
Number of network poolsUnlimited
Number of load balancersUnlimitedThis is limited by the number of processes you can start on the machine. Some versions of Open vSwitch limit the number of namespaces to 1,000. This can impact the number of load balancers. Also in the case of Octavia with amphora driver, a VM with HAProxy acts as the load balancer, so you could also be limited by the capacity on the hypervisors.

Compute service (Nova)

AreaMaximum LimitNotes
Number of virtual machines per KVM host16384This is limited by the operating system limits for process counts and open files.
Allocated RAM per KVM host64TBFor more information, see Red Hat Enterprise Linux technology capabilities and limits.
Number of virtual CPUs per virtual machine160, 240, 288, or 710The limit was raised to 710 in RHEL 8. For RHEL 7.3, the limit is 288. For RHEL 7.1 and RHEL 7.2, the limit is 240. In previous versions of RHEL, the limit is 160. For more information, see Virtualization limits for Red Hat Enterprise Linux with KVM.
RAM per virtual machine4000GBFor more information, see Virtualization limits for Red Hat Enterprise Linux with KVM.
Virtual machine swap file sizeSystem limitsThe limit is the available disk space.
Virtual NICs per virtual machine28This is determined by the number of used PCI slots and the number of available slots (depends on QEMU machine type). If there are 32 slots (pc-i440fx* machine types), then slots are allocated for video, PIIX, balloon, and disk, which leaves 28 slots for NICs; if other slots are active, then the maximum number may be lower than 28. If NICs are being assigned as vfio devices, then RHEL8 has a limit of 64 devices for pc-i440fx* machine types. Note that there is no set limit on the number of NICs if the hw_machine_type is q35, but creating too many NICs may cause CPU pressure depending on the number of CPUs that are assigned or cause a timeout trying to start up and configure a large number of NICs at boot time.
Video memory per virtual machineDriver-dependentDifferent drivers have different performance limits.
Concurrent remote console connections to a virtual machine65000Limited by the number of TCP ports available that can opened against any single IP address. This will be something less than 65535 per compute host. Since a single console server targets many hosts, you'll in fact have a 65536 concurrent connection limit across everything served by that nova console host
Serial ports per virtual machine2
Serial ports per virtual machine with virtio-consoleMany
Number of cells per region8Multiple-cells Cells V2 is supported.
Number of instancesNo known tested limitThere is no limit on the number of instances in a cloud, but the sizing of the environment, including controllers, can affect the practical limit.
Number of hosts700There is no theoretical limit on the number of hosts in a cloud, but the sizing of the environment, including controllers, can affect the practical limit. Red Hat doesn't support scaling more than 700 hosts on a single director. This is supported from RHOSP16.1 or later. For RHOSP13, we only support 500 hosts.

Image service (Glance)

AreaMaximum LimitNotes
Number of imagesUnlimitedThe practical limit depends on the underlying database performance and back end storage type.

Orchestration service / Template (Heat)

AreaMaximum LimitNotes
Number of templatesRelative to projectsThe number of templates is related to the number of projects. With the default settings, there can be no more than 100 * the number of projects.
Number of virtual machines per template1,000This is a default configuration setting.
Number of templates per project100This is a default configuration setting.

Block Storage service (Cinder)

AreaMaximum LimitNotes
Number of volumesUnlimitedSpecific databases may have relevant performance limits. No limits are imposed through the OpenStack configuration.
Number of concurrent active volumesUnlimitedThis is the control path component. The prospective volume is the raw database. The storage database may have limits on the number of active volumes.
Number of independent disksUnlimited
Number of unique storage classesUnlimited
Number of back end storage classesUnlimited
Number of mounted volumes per hostUnlimitedFor iSCSI/FC: 10,000 devices on the system. 1024 paths per multipath group and up to 1024 multipath groups. Depending on the storage backend, cinder driver, HBA driver, etc. additional limits may be in place.
Number of mounted volumes per virtual machineUnlimitedFor RHOSP13z10 and earlier, the maximum is 26 volumes. For RHOSP13z11 and later, the theoretical maximum is unlimited if using virtio-scsi. While there is no theoretical limit on the maximum number of attached volumes in RHOSP13z11 and later, physical limitations can come from: the disk bus, the hypervisor, the host OS, or the storage backend.

Identity service (Keystone)

AreaMaximum LimitNotes
Number of regionsUnlimitedThere is no technical limit within OpenStack, but overall performance depends primarily on the underlying database performance.
Total number of usersUnlimitedThere is no technical limit within OpenStack, but overall performance depends primarily on the underlying database performance.
Number of projectsUnlimitedThere is no technical limit within OpenStack, but overall performance depends primarily on the underlying database performance.
Number of users per projectUnlimitedThere is no technical limit within OpenStack, but overall performance depends primarily on the underlying database performance.
Number of active concurrent usersUnlimitedThere is no technical limit within OpenStack, but other practical performance limits apply.
Category
Article Type