A company wants AWS to benchmark a model and recommend the endpoint configuration that gives the best performance at the lowest cost for either real-time or serverless inference. Which SageMaker feature should they use?

Question

Accepted Answer

B. Amazon SageMaker Inference Recommender. Inference Recommender helps benchmark models and select endpoint configurations for real-time or serverless inference based on performance and cost. Model Monitor watches production quality and drift after deployment, not instance sizing before deployment.

A company wants AWS to benchmark a model and recommend the endpoint configuration that gives the best performance at the lowest cost for either real-time or serverless inference. Which SageMaker feature should they use?

Related Questions

Discussion