Deploy Models

Upon successful model import, the state of a model can be UNSPECIFIED, OFFLINE, ONLINE or ERROR.

  • When a model is initially created, the states is by default OFFLINE.
  • A model can be switched to OFFLINE state by invoking the model-backend endpoint /undeploy only when its original state is ONLINE.
  • A model can be switch to ONLINE state by invoking the model-backend endpoint /deploy only when its original state is OFFLINE. Model deployment operation can take time depending on factors like Internet connection and model size. Before a model is deployed online, the state will be UNSPECIFIED.
  • If the state of a model ends up with ERROR, it is undeployable on Instill Model. Please refer to Prepare Models to make your model Instill Model ready.
The finite-state-machine (FSM) diagram for the model state transition logic
The finite-state-machine (FSM) diagram for the model state transition logic
deploy
undeploy
Copy

curl -X POST http://localhost:8080/model/v1alpha/users/<user-id>/models/<model-id>/deploy

in which <user-id> and <model-id> corresponds to the namespace and ID of a model.

Last updated: 4/30/2024, 7:31:30 AM

by

HR Wu

Previous Page

Github

Next Page

Use Models