AsyncInferenceClientConfig.Builder (AWS SDK for Java - 2.37.2)

All Superinterfaces:: Buildable, CopyableBuilder<AsyncInferenceClientConfig.Builder,AsyncInferenceClientConfig>, SdkBuilder<AsyncInferenceClientConfig.Builder,AsyncInferenceClientConfig>, SdkPojo

Enclosing class:: AsyncInferenceClientConfig

@Mutable @NotThreadSafe public static interface AsyncInferenceClientConfig.Builder extends SdkPojo, CopyableBuilder<AsyncInferenceClientConfig.Builder,AsyncInferenceClientConfig>

Method Summary

Modifier and Type

Method

Description

AsyncInferenceClientConfig.Builder

maxConcurrentInvocationsPerInstance(Integer maxConcurrentInvocationsPerInstance)

The maximum number of concurrent requests sent by the SageMaker client to the model container.

Methods inherited from interface software.amazon.awssdk.utils.builder.CopyableBuilder
copy

Methods inherited from interface software.amazon.awssdk.utils.builder.SdkBuilder
applyMutation, build

Methods inherited from interface software.amazon.awssdk.core.SdkPojo
equalsBySdkFields, sdkFieldNameToField, sdkFields

Method Details
- maxConcurrentInvocationsPerInstance
  
  AsyncInferenceClientConfig.Builder maxConcurrentInvocationsPerInstance(Integer maxConcurrentInvocationsPerInstance)
  
  The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.
  
  Parameters:
  
  maxConcurrentInvocationsPerInstance - The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.
  
  Returns:
  
  Returns a reference to this object so that method calls can be chained together.