Multiple Agents on a Single Node - Output Agent Throughput - Foundation 24.1 - Foundation 24.1 - Ready - Perceptive Content - external - Perceptive-Content/Output-Agent-Throughput/Foundation-24.1/Output-Agent-Throughput/About-Output-Agent/Scaling-Output-Agent/Multiple-Agents-on-a-Single-Node - 2024-04-02

Output Agent Throughput

Platform
Perceptive Content
Product
Output Agent Throughput
Release
Foundation 24.1
License

Instances of Output Agent scale linearly. Where N is the throughput of one Output Agent, each additional instance of Output Agent on a node yields an additional 1N throughput. The number of Output Agent instances per node is only limited by hardware and network resources. The CPU and memory consumption of each additional agent also scales linearly. For example, if a single Output Agent is consuming an average of 10% CPU, adding three additional instances consumes an average of 40% CPU.