Model ServingOnline Inference Service
Managing Online Inference Services
Learn how to manage your online inference services, including rebuilding, enabling, disabling, and deleting services.
Managing Online Inference Services
Prerequisites
- You must have obtained the account and password for the management console.
- An online inference service must have already been created.
Rebuild Instance
If the current online inference service needs to be restarted, it can be achieved by rebuilding the instance.
- Log in to the management console.
- In the top navigation bar, click Products and Services > AI Computing Platform > AI Computing Platform to go to its overview page.
- In the left navigation bar, select Inference Service > Online Inference Service to enter the Online Inference Service List page.
- Click the service name/ID of an inference service (or click Service Details in the Operation column) to enter its details page.
- Select the Service Information tab. On the Instance Information card, click Rebuild Instance in the Specified Instance Operation column.
- In the pop-up prompt box, if you confirm that the corresponding information is correct, click OK.
Disable the Inference Service
- In the inference service list, click Close in the Operation column of the inference service to be closed.
- In the pop-up prompt window, if the service information is correct, click OK.
Enable Inference Service
- In the inference service list, click Enable in the Operation column of the inference service with Status "Closed."
- In the pop-up window, click OK.
Deleting an Inference Service
If the status of the online inference service is "Running", you need to close the inference service before performing subsequent operations.
- In the inference service list, click Delete in the Operation column of the inference service to be deleted.
- In the pop-up prompt window, if the service information is correct, click Delete.