o e* @s:UdZddlZddlZddlZddlZddlmZddlmZddl m Z ddl m Z m Z mZmZmZmZmZmZmZmZmZmZmZmZddlmZdd lmZdd lmZm Z m!Z!m"Z"m#Z#m$Z$d d l%m&Z&e rwdd l'm(Z(m)Z)ddl*m+Z+e,Z-ee,e fZ.ee/efZ0ee0e.e-fZ1ddhZ2e3e4Z5eGdddZ6Gdddee7Z8ddZ9ddZ:ddZ;dadee,ee,ffd d!Z?d"ee dee fd#d$Z@ed%e1dee0fd&d'ZAed%eddeedfd(d'ZAed%ee1deee0ddffd)d'ZAd%e1de,fd*d+ZBd,e,dd-fd.d/ZCd%e/defd0d1ZDd%e/defd2d3ZEd%e/dd-fd4d5ZFd6ee/d7eGdeee,ee&ffd8d9ZHd6ee/d7eGdeee,ee&ffd:d;ZIdd?dee/fd@dAZJeKZLeee,e=dB<dCee,ddfdDdEZMdCee,deGfdFdGZNdS)HzEContains utilities used by both the sync and async inference clients.N)contextmanager) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIOContextManagerDict GeneratorIterableListLiteralOptionalSetUnionoverload) HTTPError)ENDPOINT)build_hf_headers get_sessionhf_raise_for_statusis_aiohttp_availableis_numpy_availableis_pillow_available)TextGenerationStreamResponse)ClientResponse ClientSessionImagez text-to-imagezimage-to-imagec@s2eZdZUdZeed<eed<eed<eed<dS) ModelStatusa= This Dataclass represents the the model status in the Hugging Face Inference API. Args: loaded (`bool`): If the model is currently loaded. state (`str`): The current state of the model. This can be 'Loaded', 'Loadable', 'TooBig' compute_type (`str`): The type of compute resource the model is using or will use, such as 'gpu' or 'cpu'. framework (`str`): The name of the framework that the model was built with, such as 'transformers' or 'text-generation-inference'. ZloadedstateZ compute_typeZ frameworkN)__name__ __module__ __qualname____doc__bool__annotations__strr+r+QD:\Projects\ConvertPro\env\Lib\site-packages\huggingface_hub/inference/_common.pyr"Is  r"c@seZdZdZdS)InferenceTimeoutErrorzBError raised when a model is unavailable or the request times out.N)r$r%r&r'r+r+r+r,r-`sr-cCststdddl}|S)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)r/r+r+r,_import_aiohttpgr0cCststdddl}|S)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rr.numpy)r2r+r+r, _import_numpypr1r3cCststdddlm}|S)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr )rr.PILr!r r+r+r,_import_pil_imageys  r5_RECOMMENDED_MODELStaskreturnc CsFt|}|durtd|dtd|d|d|d|S)NzTask zn has no recommended task. Please specify a model explicitly. Visit https://huggingface.co/tasks for more info.zUsing recommended model z for task z7. Note that it is encouraged to explicitly set `model='zI'` as the recommended models list might get updated without prior notice.)_fetch_recommended_modelsget ValueErrorloggerinfo)r7modelr+r+r,_get_recommended_models  r?cCsBtdurtjtdtd}t|dd|DatS)Nz /api/tasks)headerscSsi|] \}}|t|dqS)Z widgetModels)_first_or_none).0r7detailsr+r+r, sz-_fetch_recommended_models..)r6rr:rrrjsonitems)responser+r+r,r9s r9rFcCs$z|dpdWStyYdSw)Nr) IndexError)rFr+r+r,rAs  rAcontentcCdSNr+rIr+r+r,_open_as_binaryrMcCrJrKr+rLr+r+r,rMrNccst|tr2|ds|dr"td|t|jVdSt|}| s2t d|dt|trZtd|| d }|VWddS1sSwYdS|VdS) zOpen `content` as a binary file, either from a URL, a local path, or raw bytes. Do nothing if `content` is None, TODO: handle a PIL.Image as input TODO: handle base64 as input zhttps://zhttp://zDownloading content from NzFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rb) isinstancer* startswithr<debugrr:rIrexistsFileNotFoundErroropen)rIfr+r+r,rMs"    " cCsPt|}t|tr |n|}t|WdS1s!wYdS)z[Encode a raw file (image, audio) into base64. Can be byes, an opened file, a path or a URL.N)rMrPbytesreadbase64 b64encodedecode)rIdataZ data_as_bytesr+r+r, _b64_encodes  $r] encoded_imager!cCst}|tt|S)z/Parse a base64-encoded string into a PIL Image.)r5rUioBytesIOrY b64decode)r^r!r+r+r, _b64_to_imagesrbcCt|S)acParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rEloadsr[rLr+r+r,_bytes_to_listrfcCrc)acParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rdrLr+r+r,_bytes_to_dictrgrhcCst}|t|S)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )r5rUr_r`)rIr!r+r+r,_bytes_to_imagesribytes_output_as_linesrCccsd|D],}|dkr q|d}|dr/t|dd}tdi|}|s,|jjn|VqdSN zutf-8zdata:z/nr+ r[rQrErelstriprstriprtokentextrjrC byte_payloadpayloadZ json_payloadoutputr+r+r, _stream_text_generation_responses  rvcCsn|2z03dHW}|dkrq|d}|dr3t|dd}tdi|}|s0|jjn|Vq6dSrkrmrrr+r+r,&_async_stream_text_generation_responses  rwclientrrGrcCs0|j2z 3dHW}|Vq6|IdHdSrK)rIclose)rxrGrsr+r+r,_async_yield_from/s rz_NON_TGI_SERVERSr>cCst|dSrK)r{addr>r+r+r,_set_as_non_tgiFsr~cCs|tvSrK)r{r}r+r+r,_is_tgi_serverJsr)Or'rYr_rElogging contextlibr dataclassesrpathlibrtypingrrrrr r r r r rrrrrrequestsr constantsrutilsrrrrrrZ_text_generationrr/rrr4r!r*ZUrlTZPathTrWZBinaryTZContentTZTASKS_EXPECTING_IMAGES getLoggerr$r<r" TimeoutErrorr-r0r3r5r6r)r?r9rArMr]rbrfrhrir(rvrwrzsetr{r~rr+r+r+r,sz   @             &