| Package | Description |
|---|---|
| org.bytedeco.tritonserver.global |
| Modifier and Type | Method and Description |
|---|---|
static TRITONSERVER_Error |
tritonserver.TRITONBACKEND_BackendAttributeAddPreferredInstanceGroup(TRITONBACKEND_BackendAttribute backend_attributes,
int kind,
long count,
long[] device_ids,
long id_count) |
static TRITONSERVER_Error |
tritonserver.TRITONBACKEND_BackendAttributeAddPreferredInstanceGroup(TRITONBACKEND_BackendAttribute backend_attributes,
int kind,
long count,
LongBuffer device_ids,
long id_count) |
static TRITONSERVER_Error |
tritonserver.TRITONBACKEND_BackendAttributeAddPreferredInstanceGroup(TRITONBACKEND_BackendAttribute backend_attributes,
int kind,
long count,
LongPointer device_ids,
long id_count)
TRITONBACKEND_BackendAttribute
API to modify attributes associated with a backend.
|
static TRITONSERVER_Error |
tritonserver.TRITONBACKEND_BackendAttributeSetParallelModelInstanceLoading(TRITONBACKEND_BackendAttribute backend_attributes,
boolean enabled)
Sets whether or not the backend supports concurrently loading multiple
TRITONBACKEND_ModelInstances in a thread-safe manner.
|
static TRITONSERVER_Error |
tritonserver.TRITONBACKEND_GetBackendAttribute(TRITONBACKEND_Backend backend,
TRITONBACKEND_BackendAttribute backend_attributes)
Query the backend for different model attributes.
|
Copyright © 2024. All rights reserved.