o e&@sJddlZddlZddlZddlZddlmZmZm Z m Z GdddZ dS)N)deserialize_bf16_tensordeserialize_bytes_tensor raise_errortriton_to_np_dtypec@s@eZdZdZddZe dddZdd Zd d Zd d Z dS) InferResultakAn object of InferResult class holds the response of an inference request and provide methods to retrieve inference results. Parameters ---------- response : geventhttpclient.response.HTTPSocketPoolResponse The inference response from the server verbose : bool If True generate verbose output. Default value is False. c CsR|d}Gddd}|d}|dur0|dkr#|t|}n |dkr0|t|}|durb|}|r>t|z t||_WdSt ya}zt d|WYd}~dSd}~wwt |}|j|d}|rrt|t||_i|_ ||_ d }|jd D]} | d } | dur| d } | dur||j | d <|| }qdS)NInference-Header-Content-Lengthc@seZdZddZdddZdS)z2InferResult.__init__..DecompressedResponsecSs||_d|_dS)NrZdecompressed_data_offset_)selfZdecompressed_datar OD:\Projects\ConvertPro\env\Lib\site-packages\tritonclient/http/_infer_result.py__init__;s z;InferResult.__init__..DecompressedResponse.__init__cS<|dkr |j|jdS|j}|j|7_|j||jSNrrr lengthZ prev_offsetr r r read? z7InferResult.__init__..DecompressedResponse.readNr)__name__ __module__ __qualname__r rr r r r DecompressedResponse:srContent-EncodinggzipdeflatezkFailed to encode using UTF-8. Please use binary_data=True, if you want to pass a byte array. UnicodeError: )rroutputs parametersbinary_data_sizename)getr decompressrzlibprintjsonloads_resultUnicodeDecodeErrorrint_output_name_to_buffer_map_buffer) r responseverbose header_lengthrcontent_encodingcontente buffer_indexoutputrthis_data_sizer r r r 6sN       zInferResult.__init__FNcCs Gddd}||||||S)aA class method to construct InferResult object from a given 'response_body'. Parameters ---------- response_body : bytes The inference response from the server verbose : bool If True generate verbose output. Default value is False. header_length : int The length of the inference header if the header does not occupy the whole response body. Default value is None. content_encoding : string The encoding of the response body if it is compressed. Default value is None. Returns ------- InferResult The InferResult object generated from the response body c@s&eZdZddZddZd ddZdS) z0InferResult.from_response_body..ResponsecSs||_d|_||d|_dS)Nr)rr)response_body_r parameters_)r response_bodyr.r/r r r r s  z9InferResult.from_response_body..Response.__init__cSs |j|S)N)r6r!)r keyr r r r!s z4InferResult.from_response_body..Response.getrcSrr)r5r rr r r rrz5InferResult.from_response_body..Response.readNr)rrrr r!rr r r r Responsesr9r )clsr7r-r.r/r9r r r from_response_bodylszInferResult.from_response_bodyc Cs|jddur|jdD]w}|d|kr|d}d}|d}|durl|d}|durld}|d krg|j|}||}|d krJt|j||} n"|d krXt|j||} ntj|j||t|d } nt d } |sytj |d t|d } | |d} | Sq dS)aGet the tensor data for output associated with this object in numpy format Parameters ---------- name : str The name of the output tensor whose result is to be retrieved. Returns ------- numpy array The numpy array containing the response data for the tensor or None if the data for specified tensor name is not found. rNr datatypeFrrTrZBYTESZBF16)Zdtypedatashape) r'r!r*rr+rnpZ frombufferremptyarrayZreshape) r r r3r<Zhas_binary_datarr4Z start_indexZ end_indexZnp_arrayr r r as_numpysD         $zInferResult.as_numpycCs(|jdD] }|d|kr|SqdS)aRetrieves the output tensor corresponding to the named output. Parameters ---------- name : str The name of the tensor for which Output is to be retrieved. Returns ------- Dict If an output tensor with specified name is present in the infer response then returns it as a json dict, otherwise returns None. rr Nr')r r r3r r r get_outputs  zInferResult.get_outputcCs|jS)zRetrieves the complete response Returns ------- dict The underlying response dict. rC)r r r r get_responseszInferResult.get_response)FNN) rrr__doc__r classmethodr;rBrDrEr r r r r)s 6 07 r) rr#numpyr?Z rapidjsonr%Ztritonclient.utilsrrrrrr r r r s