Python SDK Reference

We provide a Python SDK to programmatically access NVIDIA CCluster backend APIs to manage your deployments.

For unattended use in CI or automation, authenticate with a service account by setting CENTML_SERVICE_ACCOUNT_ID and CENTML_SERVICE_ACCOUNT_SECRET before calling the SDK. Interactive development can use centml login instead — see Client Setup.

Following is a sample code to list all the inference deployments under your account.

import centml
from centml.sdk.api import get_centml_client
from centml.sdk import DeploymentType

with get_centml_client() as cclient:
    deployments = cclient.get(DeploymentType.INFERENCE_V2)
    print(deployments)

For more examples, please refer to https://github.com/CentML/centml-python-client/blob/main/examples/sdk/

Managing hardware instances

The SDK can also list, create, and delete the hardware instances available to a cluster. See Managing Hardware Instances for details.

What's next

Managing Vault Objects

Learn how to generate and store NVIDIA CCluster tokens and other vault objects.

Clients

Learn how to interact with the NVIDIA CCluster programmatically

Get Support

Submit a Support Request