singlefabric
Model ServingOnline Inference Service

Managing Online Inference Services

Learn how to manage your online inference services, including rebuilding, enabling, disabling, and deleting services.

Managing Online Inference Services

Prerequisites

  • You must have obtained the account and password for the management console.
  • An online inference service must have already been created.

Rebuild Instance

If the current online inference service needs to be restarted, it can be achieved by rebuilding the instance.

  1. Log in to the management console.
  2. In the top navigation bar, click Products and Services > AI Computing Platform > AI Computing Platform to go to its overview page.
  3. In the left navigation bar, select Inference Service > Online Inference Service to enter the Online Inference Service List page.
  4. Click the service name/ID of an inference service (or click Service Details in the Operation column) to enter its details page.
  5. Select the Service Information tab. On the Instance Information card, click Rebuild Instance in the Specified Instance Operation column.
  6. In the pop-up prompt box, if you confirm that the corresponding information is correct, click OK.

Disable the Inference Service

  1. In the inference service list, click Close in the Operation column of the inference service to be closed.
  2. In the pop-up prompt window, if the service information is correct, click OK.

Enable Inference Service

  1. In the inference service list, click Enable in the Operation column of the inference service with Status "Closed."
  2. In the pop-up window, click OK.

Deleting an Inference Service

If the status of the online inference service is "Running", you need to close the inference service before performing subsequent operations.

  1. In the inference service list, click Delete in the Operation column of the inference service to be deleted.
  2. In the pop-up prompt window, if the service information is correct, click Delete.

On this page