| TRITONBACKEND_Backend |
| TRITONBACKEND_BackendAttribute |
| TRITONBACKEND_Batcher |
| TRITONBACKEND_Input |
| TRITONBACKEND_MemoryManager |
| TRITONBACKEND_Model |
| TRITONBACKEND_ModelInstance |
| TRITONBACKEND_Output |
| TRITONBACKEND_Request |
| TRITONBACKEND_Response |
| TRITONBACKEND_ResponseFactory |
| TRITONBACKEND_State |
| TRITONREPOAGENT_Agent |
| TRITONREPOAGENT_AgentModel |
| TRITONSERVER_BufferAttributes |
| TRITONSERVER_Error |
| TRITONSERVER_InferenceRequest |
| TRITONSERVER_InferenceRequestReleaseFn_t
Type for inference request release callback function.
|
| TRITONSERVER_InferenceResponse |
| TRITONSERVER_InferenceResponseCompleteFn_t
Type for callback function indicating that an inference response
has completed.
|
| TRITONSERVER_InferenceTrace |
| TRITONSERVER_InferenceTraceActivityFn_t
Type for trace timeline activity callback function.
|
| TRITONSERVER_InferenceTraceReleaseFn_t
Type for trace release callback function.
|
| TRITONSERVER_InferenceTraceTensorActivityFn_t
Type for trace tensor activity callback function.
|
| TRITONSERVER_Message |
| TRITONSERVER_Metric |
| TRITONSERVER_MetricFamily |
| TRITONSERVER_Metrics |
| TRITONSERVER_Parameter |
| TRITONSERVER_ResponseAllocator |
| TRITONSERVER_ResponseAllocatorAllocFn_t
TRITONSERVER_ResponseAllocator
Object representing a memory allocator for output tensors in an
inference response.
|
| TRITONSERVER_ResponseAllocatorBufferAttributesFn_t
Type for allocation function that allocates a buffer to hold an
output tensor with buffer attributes.
|
| TRITONSERVER_ResponseAllocatorQueryFn_t
Type for function that is called to query the allocator's preferred memory
type and memory type ID.
|
| TRITONSERVER_ResponseAllocatorReleaseFn_t
Type for function that is called when the server no longer holds
any reference to a buffer allocated by
TRITONSERVER_ResponseAllocatorAllocFn_t.
|
| TRITONSERVER_ResponseAllocatorStartFn_t
Type for function that is called to indicate that subsequent
allocation requests will refer to a new response.
|
| TRITONSERVER_Server |
| TRITONSERVER_ServerOptions |