An ML engineer updates a custom model serving endpoint to serve a new model version. How does Databricks handle the transition to minimize risk to live traffic?

Question

Accepted Answer

B. Databricks performs a zero-downtime update by keeping the existing endpoint configuration serving requests until the new configuration becomes ready.. Databricks Model Serving performs zero-downtime updates by maintaining the old endpoint configuration and continuing to serve traffic until the new configuration is fully deployed and ready. During this transition, both configurations may run simultaneously, and the account is billed for both until the transition completes.

An ML engineer updates a custom model serving endpoint to serve a new model version. How does Databricks handle the transition to minimize risk to live traffic?

Related Questions

Discussion