charname[RTE_ML_STR_MAX]
Model name.
Definition at line 961 of file rte_mldev.h.
charversion[RTE_ML_STR_MAX]
Model version
Definition at line 963 of file rte_mldev.h.
uint16_tmodel_id
Model ID
Definition at line 965 of file rte_mldev.h.
uint16_tdevice_id
Device ID
Definition at line 967 of file rte_mldev.h.
enumrte_ml_io_layoutio_layout
I/O buffer layout for the model
Definition at line 969 of file rte_mldev.h.
uint16_tmin_batches
Minimum number of batches that the model can process in one inference request
Definition at line 971 of file rte_mldev.h.
uint16_tmax_batches
Maximum number of batches that the model can process in one inference request
Definition at line 975 of file rte_mldev.h.
uint32_tnb_inputs
Number of inputs
Definition at line 979 of file rte_mldev.h.
conststructrte_ml_io_info*input_info
Input info array. Array size is equal to nb_inputs
Definition at line 981 of file rte_mldev.h.
uint32_tnb_outputs
Number of outputs
Definition at line 983 of file rte_mldev.h.
conststructrte_ml_io_info*output_info
Output info array. Array size is equal to nb_output
Definition at line 985 of file rte_mldev.h.
uint64_twb_size
Size of model weights and bias
Definition at line 987 of file rte_mldev.h.