Class OnnxModel

Object

OnnxModel

All Implemented Interfaces:

AutoCloseable, ImageInferenceModel<ai.onnxruntime.OnnxTensor>, InferenceModel

public class OnnxModel
extends Object
implements ImageInferenceModel<ai.onnxruntime.OnnxTensor>

A model that can be used for inference using the ONNX Runtime's Java API.

Note that a temporary directory is created by the ONNX Runtime, something ala C:\Users\owen\AppData\Local\Temp\onnxruntime-java3819764023069624084 with the final number changing. This should be deleted after the Java VM closes, but this doesn't seem to always happen. This requires further investigation, but can cause up a large buildup of files, as each instance is approximately 300MBs.

Author:

Owen Feehan

Constructor Summary

Constructors

Constructor	Description
OnnxModel(ai.onnxruntime.OrtSession session)

Method Summary

Modifier and Type	Method	Description
void	close()
<S> S	performInference(ai.onnxruntime.OnnxTensor input, String inputName, List<String> outputNames, CheckedFunction<List<ai.onnxruntime.OnnxTensor>, S, OperationFailedException> convertFunction)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

OnnxModel

public OnnxModel(ai.onnxruntime.OrtSession session)

Method Details

performInference

public <S> S performInference(ai.onnxruntime.OnnxTensor input,
 String inputName,
 List<String> outputNames,
 CheckedFunction<List<ai.onnxruntime.OnnxTensor>, S, OperationFailedException> convertFunction)
                       throws OperationFailedException

Specified by:

performInference in interface ImageInferenceModel<ai.onnxruntime.OnnxTensor>

Throws:

OperationFailedException

close

public void close()
           throws OperationFailedException

Specified by:

close in interface AutoCloseable

Specified by:

close in interface InferenceModel

Throws:

OperationFailedException