API Retries
How you can configure retries for internal storage and secrets API calls.
Kestra uses external storage and secrets so that your private data and secrets are stored in a secure way in your private infrastructure. These external systems communicate with Kestra through APIs. Those API calls, however, might eperience transient failures. To handle these transient failures, Kestra allows you to configure retries.
Here are the available retry configuration options:
kestra.retries.attempts
: the max number of retries (default5
)kestra.retries.delay
: the initial delay between retries (default1s
)kestra.retries.max-delay
: the max amount of time to retry (defaultundefined
)kestra.retries.multiplier
: the multiplier ofdelay
between each attempt (default2.0
)
Note that those retries are only applied to API calls made to internal storage (like S3 or GCS) and to secrets managers (like Vault or AWS Secrets Manager). They are not applied to tasks.
In order to globally configure retries for tasks, you can use the plugin defaults with a global scope tied to the main io.kestra
plugin path as follows:
- type: io.kestra
retry:
type: constant # type: string
interval: PT5M # type: Duration
maxDuration: PT1H # type: Duration
maxAttempt: 3 # type: int
warningOnRetry: true # type: boolean, default is false
Was this page helpful?