Prerequisites
- Web console
- CLI
-
Make sure you are in a group that has at least the
editorrole within your tenant or project; for example, the defaulteditorsgroup. You can check this in the Administration → IAM section of the web console. -
In the Administration → Limits → Quotas section, check the following quotas:
- Number of virtual machines (VMs) under Compute: make sure that at least one VM is available.
- Total number of allocations under Virtual Private Cloud: make sure that at least one allocation is available.
Steps
Create an endpoint
- Web console
- CLI
- In the sidebar, go to
Serverless AI → Endpoints.
- Click Quick start Serverless endpoint. The flow uses a preconfigured container image and default settings.
- Click Create endpoint.
Test the endpoint
- Web console
- CLI
-
In the sidebar, go to
Serverless AI → Endpoints.
-
Click the endpoint name to open its details. Wait until the endpoint is running. Then copy its managed HTTPS URL (
https://...) from the Public endpoints field. -
In a terminal, send a request to the endpoint:
In the command, specify the managed HTTPS URL that you copied earlier. The response should have HTTP status
200 OK. The body is the default nginx welcome page, which confirms that the endpoint is serving traffic over the managed HTTPS URL.
View logs
- Web console
- CLI
- In the sidebar, go to
Serverless AI → Endpoints.
- In the endpoint list, next to the endpoint, click View logs. Alternatively, click
→ View logs.
Delete the endpoint
If you no longer need the endpoint, delete it. Once you delete the endpoint, you will not be charged for it.- Web console
- CLI
- In the sidebar, go to
Serverless AI → Endpoints.
- In the endpoint list, find the endpoint and click
→ Delete.
- Confirm the endpoint deletion.
Expected results
- The endpoint is reachable over its managed HTTPS URL.
- A request without a token in the web console returns
200 OK. - A request without a token in the CLI returns
401 Unauthorizedor403 Forbidden. - An endpoint can be deleted successfully.