o ee@sddlmZmZmZmZmZddlmZmZm Z m Z ddlm Z ddlm Z  d6dededeeeeefd eeeeeffd d Z      d7dededeeeefd eeed eeedeedeedeedeed efddZ          d8dededeeeefd eeed eeedeedeedeedeedeedeedeedeed efddZ !d9d"ed#ed$eed%eed&eed'eed(eed)eed*eed efd+d,Z !d:d-ed#ed$eed%eed&eed'eed(eed)eed.eed*eed efd/d0Z !d;d"ed1ed*eed efd2d3Z !d;d-ed1ed*eed efd4d5ZdS)<)ListSetTupleOptionalMutableMapping) ModelProto GraphProtohelperchecker) TensorProto)utilsNg1g2io_mapreturncCst|tur tdt|turtddttdttdttfdd}tfdtd ttdttfd d }g}|s=g}d d |D}||||||d}t|dkr\|d|f|dd|j Ddd|j D}t|dkrz|d|f|dd|j Ddd|j D}t|dkr|d|f|dd|j Ddd|j D|dd|j Ddd|j D}t|dkr|d|f|S)aChecks whether there are name collisions between two graphs Returns a list of tuples where the first element represents the member containing overlapping names (One of: "node", "edge", "value_info", "initializer", "sparse_initializer"), and the second element contains a list of names that appear in both graphs on that category. Optionally, it takes an io_map, representing the output/inputs to be connected. It provided, overlapping present in the io_map argument will be ignored. g1 argument is not an ONNX graph g2 argument is not an ONNX graphc1c2rcSstt|t|@SN)listset)rrr._overlappinggraphexcludecSs`g}|jD](}|jD]}|dkr||vr||q |jD]}|dkr,||vr,||qq|S)N)nodeinputappendoutput)rredgesniorrr _edge_namess     z,check_overlapping_names.._edge_namescSh|]}|dqSr).0elemrrr .z*check_overlapping_names..)rredgecSg|]}|jqSrnamer*errr 7z+check_overlapping_names.. value_infocSr/rr0r2rrrr4;r5 initializercSg|]}|jjqSrvaluesr1r2rrrr4?r-cSr8rr9r2rrrr4@r-cSr8rindicesr1r2rrrr4Ar-cSr8rr;r2rrrr4Br-sparse_initializer) typer ValueErrorrstrrrlenr r6r7r=)r rrrr&resultZ io_map_inputsoverlaprrrcheck_overlapping_names s>  "$  " "  rDinputsoutputsprefix1prefix2r1 doc_stringc st|tur tdt|turtdsrFr*t} | || }t|d}r.cSr')rrrNrrrr,r-zmerge_graphs..cSr'r(rrNrrrr,r-cSsi|]\}}||qSrr)r*Zout_nameZin_namerrr sz merge_graphs..cSh|]}|jqSrr0r*r%rrrr,r5cSrSrr0r*r$rrrr,r5cSr/rr0rUrrrr4r5cSr/rr0rUrrrr4r5cg|] }|jvr|jqSrr0rU input_setrrr4cs&g|]}|jvs|jvr|jqSrr0rU)rX io_map_g2_insrrr4&cSr/rr0rTrrrr4r5cSr/rr0rTrrrr4r5cs&g|]}|jvs|jvr|jqSrr0rT)io_map_g1_outs output_setrrr4r[crVrr0rTr]rrr4rYzOutput z is not present in g1zInput z is not present in g2rz=Cant merge two graphs with overlapping names. Found repeated z names: ,  zYConsider using ``onnx.compose.add_prefix`` to add a prefix to names in one of the graphs.cg|] }|jvr|qSrr0rUrWrrr4crarr0rUrWrrr4rbcg|] }|jvr|qSrr0rUrZrrr4rbcrarr0rTr^rrr4rbcrarr0rTr^rrr4rbcrcrr0rT)r\rrr4rbcrcrr0r*initrdrrr4rbcsg|] }|jjvr|qSrr9rerdrrr4rYcrcrr0)r*virdrrr4rbN_zGraph combining  and z )r>rr?CopyFromadd_prefix_graphr!rrrAr Z Extractorr make_modelZ extract_modelrrDjoinrextendrange enumerater7r=r6r1rI)r rrrErFrGrHr1rIZg1_copyZg2_copyZreversed_io_mapZg1_outsZg2_insZ g1_inputsZ g2_inputsZ g1_outputsZ g2_outputse1e2Z g1_out_nameZ g2_in_nameZoverlapping_namescategorynamesgZg2_nodes_beginZ g2_nodes_endZnode_idxrindexr)rXr\rZr]rGrHr merge_graphsIs &       $&         " rwonnx.compose.merge_models1.0rr)m1m2 producer_nameproducer_versiondomain model_versionc  sBt|tur tdt|turtd|j|jkr'td|jd|jd|j} i}dd|jDdd|jD}|D]$}|j|vr\||j}|j|kr[td |jd |jq>|j||j<q>sgrryt}|||}t|d }rt}|||}t|d }fd d|D}t |j |j |||||d }t j || | | | || d}i}|j D]}|j||j<q|j D](}|j|vr||j}||jkrtd|jd|d |jdq|j||j<qt ||tdd|jDdd|jD@}|r tdd||j|j|j|jt||S)a=Combines two ONNX models into a single one. The combined model is defined by connecting the specified set of outputs/inputs. Those inputs/outputs not specified in the io_map argument will remain as inputs/outputs of the combined model. Both models should have the same IR version, and same operator sets imported. Arguments: m1 (ModelProto): First model m2 (ModelProto): Second model io_map (list of pairs of string): The pairs of names [(out0, in0), (out1, in1), ...] representing outputs of the first graph and inputs of the second to be connected inputs (list of string): Optional list of inputs to be included in the combined graph By default, all inputs not present in the ``io_map`` argument will be included in the combined model outputs (list of string): Optional list of outputs to be included in the combined graph By default, all outputs not present in the ``io_map`` argument will be included in the combined model prefix1 (string): Optional prefix to be added to all names in m1 prefix2 (string): Optional prefix to be added to all names in m2 name (string): Optional name for the combined graph By default, the name is g1.name and g2.name concatenated with an undescore delimiter doc_string (string): Optional docstring for the combined graph If not provided, a default docstring with the concatenation of g1 and g2 docstrings is used producer_name (string): Optional producer name for the combined model. Default: 'onnx.compose' producer_version (string): Optional producer version for the combined model. Default: "1.0" domain (string): Optional domain of the combined model. Default: "" model_version (int): Optional version of the graph encoded. Default: 1 Returns: ModelProto z m1 argument is not an ONNX modelz m2 argument is not an ONNX modelzIR version mismatch z != z2. Both models should have have the same IR versioncSg|]}|qSrrr*entryrrrr4'z merge_models..cSrrrrrrrr4(rzPCan't merge two models with different operator set ids for a given domain. Got: rirJcrLrMrrNrPrrr4@rQ)rErFr1rI)r|r}r~r opset_imports ir_versionzaCan't merge models with different values for the same model metadata property. Found: property = z, with values .cSrSrr0)r*frrrr,ar5zmerge_models..zPCan't merge models with overlapping local function names. Found in both graphs: r_)r>rr?rZ opset_importr~versionrj add_prefixrwrr rlZmetadata_propsvaluekeyZset_model_propsr functionsrmZ MergeFromr Z check_model)rzr{rrErFrGrHr1rIr|r}r~rrZopset_import_maprrZ found_versionZm1_copyZm2_copyrmodelZ model_propsZ meta_entryrZfunction_overlaprrPr merge_modelss 1                 $ rTFrrK rename_nodes rename_edges rename_inputsrename_outputsrename_initializersrename_value_infosinplacec Cst|tur td|st} | |n|} dtdtdtfdd} i} |rG| jD]} | jD] } | || | | <q.| jD] } | || | | <q;q)n"|rX| jD] }| ||j| |j<qL|ri| jD] }| ||j| |j<q]|rx| jD] } | || j| _qn|r| j D] }| ||j| |j<q}| j D]}| ||j j| |j j<| ||j j| |j j<q|r| j D] }| ||j| |j<q| jD]8} tt| jD]}| j|| vr| | j|| j|<qtt| jD]}| j|| vr| | j|| j|<qq| jD]}|j| vr| |j|_q| jD]}|j| vr| |j|_q| j D]}|j| vr(| |j|_q| j D]!}|j j| vr>| |j j|j _|j j| vrM| |j j|j _q-| j D]}|j| vr`| |j|_qR| S)aAdds a prefix to names of elements in a graph: nodes, edges, inputs, outputs, initializers, sparse initializer, value infos. It can be used as a utility before merging graphs that have overlapping names. Empty names are not prefixed. Arguments: graph (GraphProto): Graph prefix (str): Prefix to be added to each name in the graph rename_nodes (bool): Whether to prefix node names rename_edges (bool): Whether to prefix node edge names rename_inputs (bool): Whether to prefix input names rename_outputs (bool): Whether to prefix output names rename_initializers (bool): Whether to prefix initializer and sparse initializer names rename_value_infos (bool): Whether to prefix value info names inplace (bool): If True, mutates the graph directly. Otherwise, a copy will be created Returns: GraphProto #graph argument is not an ONNX graphrKr1rcSst|dkr ||S|S)Nr)rA)rKr1rrr _prefixedsz#add_prefix_graph.._prefixed)r>rr?rjr@rrr!r1r7r=r:r<r6rorA)rrKrrrrrrrrurZname_mapr#r3rrfZ sparse_initr$Zin_descZout_descr7r=r6rrrrkns                         rkrrename_functionsc  Cst|tur td| st} | || }t|j|||||||dd |rdi} |jD]} || j} | | | j<| | _q+|jD]} | jD] }|j | vrP| |j |_ qCq>|jjD] }|j | vrc| |j |_ qV|S)aAdds a prefix to names of elements in a graph: nodes, edges, inputs, outputs, initializers, sparse initializer, value infos, and local functions. It can be used as a utility before merging graphs that have overlapping names. Empty names are not _prefixed. Arguments: model (ModelProto): Model prefix (str): Prefix to be added to each name in the graph rename_nodes (bool): Whether to prefix node names rename_edges (bool): Whether to prefix node edge names rename_inputs (bool): Whether to prefix input names rename_outputs (bool): Whether to prefix output names rename_initializers (bool): Whether to prefix initializer and sparse initializer names rename_value_infos (bool): Whether to prefix value info nanes rename_functions (bool): Whether to prefix local function names inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: ModelProto #model argument is not an ONNX modelT)rrrrrrr) r>rr?rjrkrrr1rZop_type)rrKrrrrrrrrmZ f_name_maprZ new_f_namer#rrrrsB "            rdim_idxc Cst|tur td|st}||n|}dd|jD}|jD]>}tt|jD]}|j||vrA|j|d||j|<q+tt|jD]}|j||vr_|j|d||j|<qIq"|j d}|j t j dg|g|dt j |dtjd g|gd d tt|jD]E}|jd } | j d|} |j t j d | |g| j gd| j ddd| jjjjD} | |d |j t | j | jjj| q|S)aEInserts an extra dimension with extent 1 to each output in the graph. Inserts an Unsqueeze node for each output. It can be used as a utility before merging graphs, for example when the second one expects a batch dimension. Arguments: graph (GraphProto): Graph dim_idx (int): Index of the dimension to be inserted. A negative value means counting dimensions from the back. inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: GraphProto rcSr/rr0)r*r!rrrr4=r5z(expand_out_dim_graph..Z_collapsed_dim_Z_expand_out_dim_idxConstantz -constantz-valuer))r1Z data_typedimsvals)rErFr1rrZ Unsqueezez unsqueeze-)rErFr1cSr/r)Z dim_value)r*drrrr4Vr5)r>rr?rjr!rrorArr1r r Z make_nodeZ make_tensortpZINT64popZ tensor_typeshapediminsertZmake_tensor_value_infoZ elem_type) rrrruZorig_out_namesr#r$Z expand_dim_krhr%Z prev_outputZ new_shaperrrexpand_out_dim_graph sP       rcCs@t|tur td|st}|||}t|j|dd|S)aEInserts an extra dimension with extent 1 to each output in the graph. Inserts an Unsqueeze node for each output. It can be used as a utility before merging graphs, for example when the second one expects a batch dimension. Arguments: model (ModelProto): Model dim_idx (int): Index of the dimension to be inserted. A negative value means counting dimensions from the back. inplace (bool): If True, mutates the model directly. Otherwise, a copy will be created Returns: ModelProto rT)r)r>rr?rjrr)rrrrrrrexpand_out_dim]s  rr)NNNNNN) NNNNNNrxryrr))TTTTTTF)TTTTTTTF)F)typingrrrrrZonnxrrr r r rr r@rDrwintrboolrkrrrrrrrsB   D    %           l   L @