Which model types can be deployed using Mosaic AI Model Serving?

Question

Accepted Answer

C. Custom models in MLflow format, foundation models (Databricks-hosted and external), and external models from providers like OpenAI.. Mosaic AI Model Serving supports three categories of models: custom models (Python models packaged in MLflow format, including scikit-learn, XGBoost, PyTorch, and HuggingFace); foundation models (Databricks-hosted models like Meta Llama available via Foundation Model APIs, and provisioned throughput variants); and external models (models hosted outside Databricks, such as OpenAI GPT-4, governed through External Models).

Which model types can be deployed using Mosaic AI Model Serving?

Related Questions

Discussion