o e(@spddlZddlZddlmZddZddZGdd d eZd d Z d d Z ddZ ddZ ddZ ddZdS)N)SharedMemoryTensorcCs t|dd)z/ Raise error with the provided message msgN)InferenceServerExceptionrrKD:\Projects\ConvertPro\env\Lib\site-packages\tritonclient/utils/__init__.py raise_error$s r cCsR|jtjkr td|jdkr'd}tj|dgddD] }|t|7}q|SdS)a  Get the underlying number of bytes for a numpy ndarray. Parameters ---------- tensor_value : numpy.ndarray Numpy array to calculate the number of bytes for. Returns ------- int Number of bytes present in this tensor z)The tensor_value dtype must be np.object_rrefs_okCflagsorder)dtypenpobject_r sizenditerlenitem)Z tensor_value total_bytesobjrrrserialized_byte_size+s  rcsBeZdZdZd ddZfddZddZd d Zd d ZZ S)rzException indicating non-Success status. Parameters ---------- msg : str A brief description of error status : str The error code debug_details : str The additional details on the error NcCs||_||_||_dS)N)_msg_status_debug_details)selfrstatus debug_detailsrrr__init__Ws z!InferenceServerException.__init__cs:|jdur tn|j}|jdurd|jd|}|S)N[z] )rsuper__str__r)rr __class__rrr"\s z InferenceServerException.__str__cC|jS)zGet the exception message. Returns ------- str The message associated with this exception, or None if no message. )rrrrrmessageb z InferenceServerException.messagecCr%)zGet the status of the exception. Returns ------- str Returns the status of the exception )rr&rrrrmr(zInferenceServerException.statuscCr%)zGet the detailed information about the exception for debugging purposes Returns ------- str Returns the exception details )rr&rrrrxs z&InferenceServerException.debug_details)NN) __name__ __module__ __qualname____doc__rr"r'rr __classcell__rrr#rrGs    rcCs|tkrdS|tjkr dS|tjkrdS|tjkrdS|tjkr"dS|tjkr)dS|tjkr0dS|tjkr7dS|tj kr>d S|tj krEd S|tj krLd S|tj krSd S|tj ks^|jtjkr`d SdS)NBOOLINT8INT16INT32INT64UINT8UINT16UINT32UINT64FP16FP32FP64BYTES)boolrint8int16int32int64uint8uint16uint32uint64float16float32float64rtypebytes_)Znp_dtyperrrnp_to_triton_dtypes6           rIcCs|dkrtS|dkr tjS|dkrtjS|dkrtjS|dkr"tjS|dkr)tjS|dkr0tjS|dkr7tjS|d kr>tj S|d krEtj S|d ksM|d krPtj S|d krWtj S|dkr^tj SdS)Nr.r/r0r1r2r3r4r5r6r7r8ZBF16r9r:)r;rr<r=r>r?r@rArBrCrDrErFrrrrrtriton_to_np_dtypes6rKcCs|jdkrtjdgtjdS|jtjkr|jjtjkrtdg}tj|dgddD]3}|jtjkrIt| t kr?| }nt |  d}n| }| tdt|| |q*d |}tj|tjd}|jd sxtj|tjd}|S) al Serializes a bytes tensor into a flat numpy array of length prepended bytes. The numpy array should use dtype of np.object_. For np.bytes_, numpy will remove trailing zeros at the end of byte sequence and because of this it should be avoided. Parameters ---------- input_tensor : np.array The bytes tensor to serialize. Returns ------- serialized_bytes_tensor : np.array The 1-D numpy array of type uint8 containing the serialized bytes in row-major form. Raises ------ InferenceServerException If unable to serialize the given tensor. rrJz/cannot serialize bytes tensor: invalid datatyper r r zutf-8s >8 ,