serving-small-and-medium-sized-models.adoc

Serving small and medium-sized models

On the multi-model serving platform, multiple models can be deployed from the same model server and share the server resources.

Configuring model servers

modules/enabling-the-multi-model-serving-platform.adoc modules/adding-a-custom-model-serving-runtime-for-the-multi-model-serving-platform.adoc modules/adding-a-tested-and-verified-runtime-for-the-multi-model-serving-platform.adoc modules/adding-a-model-server-for-the-multi-model-serving-platform.adoc modules/deleting-a-model-server.adoc

Working with deployed models

modules/deploying-a-model-using-the-multi-model-serving-platform.adoc modules/viewing-a-deployed-model.adoc modules/updating-the-deployment-properties-of-a-deployed-model.adoc modules/deleting-a-deployed-model.adoc

modules/viewing-metrics-for-the-multi-model-serving-platform.adoc

Monitoring model performance

In the multi-model serving platform, you can view performance metrics for all models deployed on a model server and for a specific model that is deployed on the model server.

modules/viewing-performance-metrics-for-model-server.adoc modules/viewing-http-request-metrics-for-a-deployed-model.adoc