Uses of Package
org.bytedeco.tritonserver.tritondevelopertoolsserver

Packages that use org.bytedeco.tritonserver.tritondevelopertoolsserver

Package	Description
org.bytedeco.tritonserver.tritondevelopertoolsserver

Classes in org.bytedeco.tritonserver.tritondevelopertoolsserver used by org.bytedeco.tritonserver.tritondevelopertoolsserver

Class and Description
Allocator Custom Allocator object for providing custom functions for allocator.
BackendConfig Structure to hold backend configuration for setting 'ServerOptions'.
CUDAMemoryPoolByteSize Structure to hold CUDA memory pool byte size for setting 'ServerOptions'.
GenericInferRequest Object that describes an inflight inference request.
GenericInferResult An interface for InferResult object to interpret the response to an inference request.
GenericTritonServer Object that encapsulates in-process C API functionalities.
HostPolicy Structure to hold host policy for setting 'ServerOptions'.
InferOptions Structure to hold options for Inference Request.
LoggingOptions Structure to hold logging options for setting 'ServerOptions'.
MetricsOptions Structure to hold metrics options for setting 'ServerOptions'.
ModelLoadGPULimit Structure to hold GPU limit of model loading for setting 'ServerOptions'.
NewModelRepo Structure to hold the full path to the model repository to be registered and the mapping from the original model name to the overridden one.
OutputBufferReleaseFn_t
RateLimitResource Structure to hold rate limit resource for setting 'ServerOptions'.
RepositoryIndex Structure to hold repository index for 'ModelIndex' function.
ResponseAllocatorAllocFn_t Custom Response Allocator Callback function signatures.
ResponseAllocatorStartFn_t
ServerOptions Server options that are used to initialize Triton Server.
StringSet
StringSet.Iterator
StringVector
StringVector.Iterator
Tensor Structure to hold information of a tensor.
Trace Structure to hold global trace setting for 'ServerOptions' and model-specific trace setting for 'InferOptions'.
TritonException