o ez'@sdZddlmZddlmZddlmZddlZddlZddl Z ddl m Z ddl m Z mZmZmZmZmZmZmZddlZddlZdejvrPeejdd and ejvr_eejd d d an eejd d d d aGdddZdeddfddZdefddZdedeeeeffddZdede fddZ!d/dede defddZ"ded eddfd!d"Z# d0ded$eed%ee ede efd&d'Z$d1d$eded(ee%defd)d*Z& #   d2d$eded(ee%d+e d,e deej'f d-d.Z(dS)3zJONNX Model Hub This implements the python client for the ONNX model hub. )join)urlopen) HTTPErrorN)BytesIO)ListOptionalDictAnyTuplecastSetIOZ ONNX_HOMEZhubZXDG_CACHE_HOMEonnx~z.cachec@sFeZdZdZdeeefddfddZdefddZdefd d Z dS) ModelInfoaR A class to represent a model's property and metadata in the ONNX Hub. It extracts model name, path, sha, tags, etc. from the passed in raw_model_info dict. Attributes: model: The name of the model. model_path: The path to the model, relative to the model zoo (https://github.com/onnx/models/) repo root. metadata: Additional metadata of the model, such as the size of the model, IO ports, etc. model_sha: The SHA256 digest of the model file. tags: A set of tags associated with the model. opset: The opset version of the model. raw_model_inforeturnNcCstt|d|_tt|d|_ttttf|d|_d|_d|jvr-tt|jd|_t|_ d|jvrCttt t|jd|_ tt |d|_ ||_ dS)z` Parameters: raw_model_info: A JSON dict containing the model info. model model_pathmetadataN model_shatagsZ opset_version)r strrrrr rrsetrrintopsetr)selfrr8D:\Projects\ConvertPro\env\Lib\site-packages\onnx/hub.py__init__'s   zModelInfo.__init__cCsd|j|j|j|jS)Nz3ModelInfo(model={}, opset={}, path={}, metadata={}))formatrrrrrrrr__str__;szModelInfo.__str__cCs|SN)r"r!rrr__repr__@szModelInfo.__repr__) __name__ __module__ __qualname____doc__rrr rr"r$rrrrrs  rnew_dirrcCs|adS)zg Sets the current ONNX hub cache location :param new_dir: location of new model hub cache N _ONNX_HUB_DIR)r)rrrset_dirDsr,cCstS)zi Gets the current ONNX hub cache location :return: The location of the ONNX hub model cache r*rrrrget_dirNsr-repocCsV|dd}|dddd}d|vr$|dddd}nd}|||fS)zM Gets the repo owner, name and ref from a repo specification string. /r:main)splitr. repo_owner repo_namerepo_refrrr_parse_repo_infoWs  r8cCs&t|\}}}|dko|dko|dkS)z Verifies whether the given model repo can be trusted. A model repo can be trusted if it matches onnx/models:main. rmodelsr2r8r4rrr_verify_repo_refdsr;FlfscCsBt|\}}}|rd|d|d|dSd|d|d|dS)a8 Gets the base github url from a repo specification string :param repo: The location of the model repo in format "user/repo[:branch]". If no branch is found will default to "main" :param lfs: whether the url is for downloading lfs models :return: the base github url for downloading z*https://media.githubusercontent.com/media/r/z"https://raw.githubusercontent.com/r:)r.r<r5r6r7rrr _get_base_urlms r=url file_namec Csd}t|5}t|d} ||}|sn||qWdn1s&wYWddSWddS1s>wYdS)z Downloads the file with specifed file_name from the url :param url: a url of download link :param file_name: a specified file name for the downloaded file i@wbTN)ropenreadwrite)r>r? chunk_sizeresponsefchunkrrr_download_file~s  PrHonnx/models:mainrrc st|}|d}z%t|}ddtttt|D}Wdn1s'wYWntyA}ztd||d}~wwdurH|nfdd|D}|durW|Sdd|D} g} |D]} d d| j D} t | | d krz| | qb| S) a Gets the list of model info consistent with a given name and tags :param repo: The location of the model repo in format "user/repo[:branch]". If no branch is found will default to "main" :param model: The name of the model to search for. If `None`, will return all models with matching tags. :param tags: A list of tags to filter models by. If `None`, will return all models with matching name. :return: list of ModelInfo zONNX_HUB_MANIFEST.jsoncSsg|]}t|qSr)r).0inforrr zlist_models..NzCould not find manifest at cs"g|] }|jkr|qSr)rlowerrJmrrrrLs"cSh|]}|qSrrNrJtrrr rMzlist_models..cSrRrrSrTrrrrVrMr) r=rjsonloadr r rrAssertionErrorrlen intersectionappend) r.rrbase_urlZ manifest_urlrEmanifestematching_modelsZcanonical_tagsZmatching_info_listrPZ model_tagsrrQr list_modelss,    rarcst||}|std|durt|ddd}|dSfdd|D}t|dkr@d d|D}t|d d ||dS) a Gets the model info matching the given name and opset. :param model: The name of the onnx model in the manifest. This field is case-sensitive :param repo: The location of the model repo in format "user/repo[:branch]". If no branch is found will default to "main" :param opset: The opset of the model to get. The default of `None` will return the model with largest opset. :return: ModelInfo zNo models found with name NcSs|j Sr#r)rPrrrsz get_model_info..)keycsg|] }|jkr|qSrrbrOrbrrrLsz"get_model_info..rcSsg|]}|jqSrrbrOrrrrLsz has no version with opset z. Valid opsets: )rarYsortedrZ)rr.rr`Zselected_modelsZ valid_opsetsrrbrget_model_infos  rf force_reloadsilentc Csrt|||}|jd}|jdur|jd|d|d<tttj|}|s.tj |spt |sM|sMd |}t |t jdt dtdkrMdStjtj|d d t|d } t d |d |t| |j|n t d |d|t|d } | } Wdn1swY|jdurt| } | |jkstd | |jttttt | S)aq Downloads a model by name from the onnx model hub :param model: The name of the onnx model in the manifest. This field is case-sensitive :param repo: The location of the model repo in format "user/repo[:branch]". If no branch is found will default to "main" :param opset: The opset of the model to download. The default of `None` automatically chooses the largest opset :param force_reload: Whether to force the model to re-download even if its already found in the cache :param silent: Whether to suppress the warning message if the repo is not trusted. :return: ModelProto or None r/N_zThe model repo specification "{}" is not trusted and may contain security vulnerabilities. Only continue if you trust this repo.)filezContinue?[y/n]yT)exist_okz Downloading z to local path z Using cached z model from rbzThe cached model has SHA256 {} while checksum should be {}. The model in the hub may have been updated. Use force_reload to download the model from the model hub.)!rfrr3rrr+osseppathexistsr;r printsysstderrinputrNmakedirsdirnamer=rHrArBhashlibsha256 hexdigestrYrrXr r bytesr) rr.rrgrhZselected_modelZlocal_model_path_arrZlocal_model_pathmsgZlfs_urlrFZ model_bytesZdownloaded_sharrrrXs<          rX)F)rINN)rIN)rINFF))r(Zos.pathrurllib.requestr urllib.errorrrWroryiortypingrrrr r r r r rrtenvironr+rq expanduserrrr,r-r8boolr;r=rHrarrfZ ModelProtorXrrrrsf    (  +      $