Skip to content

Commit 7bf7d1f

Browse files
Ahmad, Sufianmboglesby
authored andcommitted
Fixed descriptions for Allocate resource.
1 parent 60d03d2 commit 7bf7d1f

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

netapp_dataops_k8s/docs/inference_server_management.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@ The following options/arguments are optional:
3838
-n, --namespace= Kubernetes namespace to create new server instance in. If not specified, server will be created in namespace "default".
3939
-p, --cpu= Number of CPUs to reserve for Triton instance. Format: '0.5', '1', etc. If not specified, no CPUs will be reserved.
4040
-b, --load-balancer Option to use a LoadBalancer instead of using NodePort service. If not specified, NodePort service will be utilized.
41-
-r, --allocate-resource= Option to specify custom resource allocations. If not specified, no custom resource will be allocated.
41+
-r, --allocate-resource= Option to specify custom resource allocations, ex. 'nvidia.com/mig-1g.5gb=1'. If not specified, no custom resource will be allocated.
4242
```
4343

4444
##### Example Usage
@@ -163,7 +163,7 @@ def create_triton_server(
163163
request_cpu: str = None, # Number of CPUs to reserve for Triton instance. Format: '0.5', '1', etc. If not specified, no CPUs will be reserved.
164164
request_memory: str = None, # Amount of memory to reserve for Triton instance. Format: '1024Mi', '100Gi', '10Ti', etc. If not specified, no memory will be reserved.
165165
request_nvidia_gpu: str = None, # Number of NVIDIA GPUs to allocate to Triton instance. Format: '1', '4', etc. If not specified, no GPUs will be allocated.
166-
allocate_resource: str = None, # Option to specify custom resource allocations. If not specified, no custom resource will be allocated.
166+
allocate_resource: str = None, # Option to specify custom resource allocations, ex. 'nvidia.com/mig-1g.5gb=1'. If not specified, no custom resource will be allocated.
167167
print_output: bool = False # Denotes whether or not to print messages to the console during execution.
168168
) -> str :
169169
```

0 commit comments

Comments
 (0)