A customer facing application is sensitive to latency spikes during busy periods and wants better output token latency for eligible models without redesigning the app. Which Bedrock service tier should the team evaluate?

Question

Accepted Answer

B. Priority. AWS states that Priority tier can provide better latency characteristics than Standard for eligible models, including improved output tokens per second during high demand. Flex is intended for delayed processing rather than latency sensitive interactions. Priority is therefore the best answer.

A customer facing application is sensitive to latency spikes during busy periods and wants better output token latency for eligible models without redesigning the app. Which Bedrock service tier should the team evaluate?

Related Questions

Discussion