Throttle Execution refers to controlling the rate at which the executions are carried out within a specific timeframe. Users can enable throttling their execution to overcome rate limit issues.
Note: Throttling occurs at the Organization level. When multiple automated processes are executed, they are processed in the order they are received, that is, following a first-come, first-serve approach.
What is Throttling in Automation Hub?
Suppose an organization has set a rate limit of 100 executions per minute, but the execution request it receives is 1000 per minute. This is much higher than the established limit. In this case, the execution will not work correctly, potentially resulting in automation failures.
To address this issue, the organization can choose to implement execution throttling . When a user triggers an automation 1000 times, these automations will be queued and the executions will be performed sequentially.
In short, the automations that have throttling enabled in their settings will go through the executions sequentially.
You can view your automation's success and queue status in the Execution Log section.
Note: The queued executions will retry to execute three times before going into the Rejected status in case of any errors, such as engine failure.
What Happens if an Automation is Not Throttled?
If an automation is not set to throttle the execution, it will go in the Direct Queue. In Direct Queue, the rate limit is set to 5000 executions per minute per organization.
To use the Direct Queue for executions, you must ensure that the automation is not hitting other rate limits such as CMA limits.
Execution request(s) will be sent to the direct queue only if your automation does not contain the Response connector.
The Response connector works synchronously in the background to fetch the response from any server. If an automation contains the Response connector, it will send the response based on the configuration and if it goes in the Direct Queue for execution, you might not be able to view the response.