o ez@s.ddlZddlmZddlTGdddZdS)N) MessageToJson)*c@s4eZdZdZddZddZd ddZd d d Zd S) InferResultzAn object of InferResult class holds the response of an inference request and provide methods to retrieve inference results. Parameters ---------- result : protobuf message The ModelInferResponse returned by the server cCs ||_dS)N)_result)selfresultrOD:\Projects\ConvertPro\env\Lib\site-packages\tritonclient/grpc/_infer_result.py__init__-s zInferResult.__init__cCsd}|jjD]k}|j|krmg}|jD]}||q|j}|t|jjkrM|dkr2t|jj|}n2|dkr?t |jj|}n%t j |jj|t |d}nt|j jdkr_t j|j jdd}nt d}||}|S|d7}qdS) aGet the tensor data for output associated with this object in numpy format Parameters ---------- name : str The name of the output tensor whose result is to be retrieved. Returns ------- numpy array The numpy array containing the response data for the tensor or None if the data for specified tensor name is not found. rZBYTESZBF16)ZdtypeF)copyN)routputsnameshapeappenddatatypelenZraw_output_contentsZdeserialize_bytes_tensorZdeserialize_bf16_tensornpZ frombufferZtriton_to_np_dtypecontentsZbytes_contentsarrayemptyZreshape)rrindexoutputrvaluerZnp_arrayrrr as_numpy0s6          zInferResult.as_numpyFcCs6|jjD]}|j|kr|rt|ddq|SqdS)aRetrieves the InferOutputTensor corresponding to the named output. Parameters ---------- name : str The name of the tensor for which Output is to be retrieved. as_json : bool If True then returns response as a json dict, otherwise as a protobuf message. Default value is False. The returned json is generated from the protobuf message using MessageToJson and as a result int64 values are represented as string. It is the caller's responsibility to convert these strings back to int64 values as necessary. Returns ------- protobuf message or dict If a InferOutputTensor with specified name is present in ModelInferResponse then returns it as a protobuf message or dict, otherwise returns None. TZpreserving_proto_field_nameN)rr rr)rras_jsonrrrr get_outputcs  zInferResult.get_outputcCs|r tt|jddS|jS)aRetrieves the complete ModelInferResponse as a json dict object or protobuf message Parameters ---------- as_json : bool If True then returns response as a json dict, otherwise as a protobuf message. Default value is False. The returned json is generated from the protobuf message using MessageToJson and as a result int64 values are represented as string. It is the caller's responsibility to convert these strings back to int64 values as necessary. Returns ------- protobuf message or dict The underlying ModelInferResponse as a protobuf message or dict. Tr)jsonloadsrr)rrrrr get_responses  zInferResult.get_responseN)F)__name__ __module__ __qualname____doc__r rrr rrrr r"s   3"r)Z rapidjsonrZgoogle.protobuf.json_formatrZtritonclient.utilsrrrrr s