iSSKrSSKrSSKJr SSKJrJrJrJrJ r J r J r SSK r SSK Js Jr SSKJrJr SSKJr SSKJr SSKJrJr SSKJr SS KJr SS KJ r SS K!J"r"J#r# SS K$J%r% SS K&J'r' SSK(J)r) SSK*J+r+ SSK,J-r-J.r.J/r/J0r0J1r1J2r2J3r3J4r4J5r5J6r6 SSK7J8r8J9r9J:r:J;r;J[TU]5 XlX lX0lX@lXPlSUlgN)super__init__r0r-r.r/r1r2)selfr3r4r5r6r7 __class__s e/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/executorch/exir/lowered_backend_module.pyr<LoweredBackendModule.__init__Gs5 *6'% /+(?% memoc 8[[R"URR5[R"URR 5[R"URR 5URR[R"URR5[R"URR5URR[R"URR5/S9n[UURUR[R"URU5UR S9n[R"[#US055UlU$)Nrootgraphgraph_signature state_dictrange_constraintsmodule_call_graph constants verifiers)r3r4r5r6r7r2)rcopydeepcopyr0 graph_modulerFrGrHrIrJrKverifierr+r-r.r/r1getattrr2)r=rBcopied_programress r? __deepcopy__!LoweredBackendModule.__deepcopy__Xs*(t>>KKL-- ? ? E EF MM//??66AA"mm//AA#mm//AA55??}}T%D%D%M%MNO "#''' 11--(;(;TB$($A$A  99WT6267 rAcUR$)z Returns the backends name. )r-r=s r?r4LoweredBackendModule.backend_idus rAcUR$)z; Returns the delegate blob created from backend.preprocess )r.rWs r?r5$LoweredBackendModule.processed_bytes|s $$$rAcUR$)zi Returns a list of backend-specific objects with static metadata to configure the "compilation" process. )r/rWs r?r6"LoweredBackendModule.compile_specss """rAcUR$)z" Returns the original EXIR module )r0rWs r?original_module$LoweredBackendModule.original_modules ...rAcUR$)z% Returns the Named Data Store Output )r1rWs r?r7,LoweredBackendModule.named_data_store_outputs ,,,rAextract_delegate_segmentssegment_alignmentconstant_tensor_alignmentdelegate_alignmentmemory_planningc p[[[URUS9URS9UUUUS95nU$)z? Returns a buffer containing the serialized ExecuTorch binary. )rf)program named_data)pte_filerbrcrdre)bytesr r rhr7)r=rbrcrdrerfouts r?bufferLoweredBackendModule.buffersK !! LLLI#;;+D"3*C#5    rAemit_stacktracec  SSKJnJn [R"UR 5nUR RVs/sHcnURS:XdMURURR;dM;URURR;dMaUPMe nnUR R5nUR RU5 [UR R5H0nURS:wdMUR RU5 M2 UR RHznURS:XdMURURR;d&URURR;dM_UR RU5 M| [!UR"U5n UR R%U 5n UR R'[(U /UQ75n UR R R5R*Sn [-U Vs/sHn[/UR0S5PM sn5U R0S'[-U Vs/sHofR0SPM sn5U R0S'/n [3[5U 55H\nUR R'[6R8X4S9nU R0SUUR0S'U R;U5 M^ UR R=U 5 UR"R?5 UR RA5 U Vs/sH-n[C[DRF[IURS9SS9PM/ nnURRnURRnURRJVs/sH=nUU;dM UU;dM[M[NRP[IWRS9SS9PM? nn[SUR"UR U"[UUUS 9UR"50URVURXSURZ/S 9nUc []5nU"U[_5U5n[aUUS 9RbnU$s snfs snfs snfs snfs snf) Nr)_get_updated_graph_signature _transform placeholdervalspec)argsnamekindargtarget input_specs output_specs)rErFrGrHrIrJexample_inputsrL)ro)2 executorch.exir.program._programrqrrrMrNr0rFnodesoprxrGinputs_to_buffersinputs_to_parameters output_node erase_nodereversedrrOget_attr call_functionrrvtuplerr2rangelenoperatorgetitemappendoutput recompilelintr"r! USER_OUTPUTr# user_inputsrr USER_INPUTrrrIrJrPrrrrh)r=rorfrqrrlowered_exported_programnodeall_input_nodesr lowered_name lowered_node delegate_nodeoriginal_output_nodes getitem_nodesi getitem_noderrr user_inputr~exported_programemitted_programs r?rhLoweredBackendModule.programs  <$(==1P1P#Q 166<<  <=( II/??QQR  II/??TTU <   /44@@B  !&&11+>5;;AABDww-'(..99$?C -2288Dww-' 5EEWWW99+;;PPQ)..99$? 9/ $ 1 14 055>>|L 166DD $|&Fo&F  + + 1 1 = = ? D DQ G &+5J K5JTYtyy' (5J K& 6"%**? @*?$YYu *? @% 5!  s012A399GG  #'HL(5'9'9%'@'CL  e $   . 3 !&&--m< --779 &&++-!.  !. ++" (9(9:  !.   % 4 4 I I 5DDVV7FFRR  S !55  "33 I))" 2  S   +)66*008$ +,)55 6HH6HH/889# &  "02O%&6 X& o ' s  d L A$   s<S"S"S&S"S#S( 4S- S2S2.S2rvkwargs.c[U/UQ76$r:)r)r=rvrs r?forwardLoweredBackendModule.forward`s (4t44rA)r-r/r1r0r.r2r:)FNNN)FN)"__name__ __module__ __qualname____firstlineno____doc__str__annotations__rkrrrrr rrr<intrTpropertyr4r5r6r^r7boolrrmrrhrr r__static_attributes__ __classcell__)r>s@r?r+r+6s !0/& 4S> ""CG %  K(  "**>!?  "$sCx.!9>T: C  %%% #tK0## /// -2F)G--+0!$37,0.2 #'$,C=  %SM  ,  <!&.2gg,g  gV55s #5  55rAr+gmr8c[URR5GH*nURS:XdMURR U5 [ UR 5S:XdeUR Sn[U[RR5(a~URRS5n[U[5(aN[[ U55Vs/sH/n[RRU5UR PM1 nnSSS5 ["R$"W5upVU4Ul g gs snf!,(df  N8=f)Nrrrt)rrFrrinserting_beforerrv isinstancetorchfxNoder2getlistrProxyrpytree tree_flatten)rroutputsrtrreturnsout_specs r?_fixup_output_noderis( 77h **40499~***))A,guxx}}55!,,**51C!#t,, FK3s8_#ETEHHNN73A6;;_ #1!' 3 3G < G DI !)#10sBE+6E!EE E# owning_programc^ [RR5n0m URn/n/n/nURR HnUR S:waMURUR;a3URRSS5U:XaURU5 MbURUR;a3URRSS5U:XaURU5 MURU5 M UHn URU U 4Sj5n U T U 'M UHn URU U 4Sj5n U T U 'M UHn URU U 4Sj5n U T U 'M URR H0nUR S:XaMURUU 4Sj5n U T U'M2 UR5 URRUlX0lU$)a Modifies the graph of the given graphmodule with one that contains the same nodes as the original, but with placeholders in order of (Params + Buffers) (User Inputs) This is used by the delegate api which disturbs the placeholder ordering when creating a submodule from partitioned nodes Args: gm: The graph module that we want arranged owning_program: ExportedProgram that the submodule (gm) belongs to Returns: The graph module in-placed arranged rsdelegation_tagNc>TU$r:xnode_maps r?,arrange_graph_placeholders.. Xa[rAc>TU$r:rrs r?rrs hqkrAc>TU$r:rrs r?rrrrAc>TU$r:rrs r?rrs x{rA)rrGraphrGrFrrrxrr2rrr node_copyr_codegen)rrtag new_graph graph_sign param_nodes buffer_nodes input_nodesr param_nodenew_node buffer_node input_noders @r?arrange_graph_placeholdersr}s" IH//JKLK 77m #  II88 8 .5<   t $ II55 5 .5<    %   t $"" &&z3HI'"$ &&{4IJ ($" &&z3HI'"  77m # &&t-BC! NN**IH IrAoriginal_programcall_module_noder is_submodulec  ^^URn/n/n0n0n 0m0mU(d1URV s0sHoRRU _M sn O0n [ [ 5n U(d:UR H*n XRRRU 5 M, URRGH-nURS:XGaURU ;a;UR[[R[URS9SS95 M`XRn[UR[5(dURU5 GOiUR R#SS5U:XGaURU5 UR$[R:XaMXUR'UR&nUUR(;aCUR$[R*[R,4;deUR(UTU'OUUR.;aRUR$[R0[R2[R,4;deUR.UTU'OH[5SUS35eUR[[R[URS9SS95 URS:XdGM[ [ 5nUR6R95HnURU ;dMURS :XaUR&[:R<:Xd$S US URS UR&35eUR>S n[U[@5(dS[CU535eUUREU UR5 M [GUR>S5GHunnUU;Gae[U[HRJRL5(deUUn[OUU4SjU55(aUVs/sHGnUR$[PRR:XdM#UR&T;dUR&T;dMEUPMI snSn[UU5S :XdSUR&SUS35eUR[W[PRR[URS9UR&S95 UU URR'GM7UR[W[PRX[URS9SS95 GMs[U[HRJRL5(d3UR[W[PRX[[SUS9SS95 GMUR[W[PRX[URS9SS95 GM GM0 []XgS9nUTTUU 4$s sn fs snf)a Args: original_program: The original program that we are paritioning gm: The partitioned graph module. call_module_node: The node in the original program that is calling the partitioned graph module. tag: The tag being used for this partitioned submodule. This is used to tell if a particular parameter/buffer/constant node is being tagged, aka consumed by the delegate. is_submodule: True if we are currently partitioning inside of a submodule (like cond's submodule). If we are inside of a submodule, we do not care about consuming params/buffers. Returns: new_signature (ExportGraphSignature): The new signature for the partitioned graph module. new_state_dict (Dict[str, Union[torch.Tensor, torch.nn.Parameter]]): The new state dict containing the consumed params/buffers. new_constants (Dict[str, Union[torch.Tensor, FakeScriptObject, torch.ScriptObject]]): The new constants table containing the consumed constants . input_specs_to_delete (Dict[str, InputSpec]): The input specs that have been consumed by the delegate (param/buffer input nodes) and should be removed from the toplevel ExportedProgram. output_specs_to_delete (Dict[str, InputSpec]): The output specs that have been consumed by the delegate (buffer mutation nodes) and should be removed from the toplevel ExportedProgram. rsrwNryrInvalid input spec receivedrr Invalid user , node.op is  and node.target is rInvalid getitem type: rc3># UHNnUR[R:H=(a% URT;=(d URT;v MP g7fr:)rzr!BUFFER_MUTATIONr|).0orig_output_spec new_constantsnew_state_dicts r? %_get_new_signature..Vs\ 1B, )--1K1KK,33~EH/66-G 1BsAAz Constant a  was tagged to be consumed by the buffer, and was found to also contain a buffer mutation. However this buffer mutation node was found to also be used as other types of outputs which is currently not supported. Please file an issue on Github. The toplevel program:  )rxvaluer})/rGr~r{rxrrrrrFrrrrrr#rr2rrzr|rH PARAMETERBUFFERrKCONSTANT_TENSOR CUSTOM_OBJ RuntimeErroruserskeysrrrvrtypeextend enumeraterrranyr!rrr"rrr)rrrrr old_signaturer~rinput_specs_to_deleteoutput_specs_to_delete input_specinput_node_to_sigtoplevel_output_node_to_sig output_specrorig_input_spec input_targetbuffer_mutation_idxsuser getitem_idxrrorig_output_specsr new_signaturerrs @@r?_get_new_signaturersT%44MKLNM BB""?3/6#=""?3"''9+?+?? 4Cdii0.55 #3#>#>>*//!++!((4 4D3N3N$4N<0"%5%?%??*//!11!,,!((4 3C2L2L$3M,/')<_6#,DIIaL"9;,,%k588==AAAA( I#3#:#:m#K -4E,,( ##45:'(8(?(?'@A5 6F4Fb J:%++&%/%?%?$2 8H8H$I'7'>'>-//?/C/C/H/HI%++&%/%;%;$2 8H8H$I'+$K?? ''"!+!7!7 0b L#'!''"!+!7!7 .K4D4D E#'G#:Yn)M   K VR,s W=8"XXX submodulec[XU5n[XX2U5unnnnn [R"[ UR 5045Sn [R"UR 5Sn [UURUU[R"UR5[S[//XS95/UUR/S9UU 4$)a Creates an ExportedProgram from the given submodule using the parameters and buffers from the top-level owning program Args: submodule: submodule to create and exported program from owning_program: exported program containing the parameters and buffers used within the submodule Returns: The ExportedProgram created from submodule input_specs_to_delete (Dict[str, InputSpec]): The input specs that have been consumed by the delegate (param/buffer input nodes) and should be removed from the toplevel ExportedProgram. output_specs_to_delete (Dict[str, InputSpec]): The output specs that have been consumed by the delegate (buffer mutation nodes) and should be removed from the toplevel ExportedProgram. rr)inputsrin_specrrD)rrrrrr user_outputsrrFrMrNrIrr rP) rrrrrsubgraph_signaturesubgraph_state_dictsubgraph_constantstoplevel_input_specs_to_deletetoplevel_output_specs_to_deleterrs r?&create_exported_program_from_submodulers4+9cJI #3,  &' !!5);)G)G#H""MNqQG""#5#B#BCAFH //.*"mmN,L,LM'!2w)%../ " ''' rA node_listskip_legalize_graphc[U5nSU-n[XU5upgn[U5 [XXx5nSn URR H)n U R S:XdMU RU:XdM'U n M+ U c[SUSURS35e[U5S:Xa[USRS [5(aURRU 5 [RR!U 5SR"n U R%U 5 U RS U RS 'U S4U lSSS5 OKU R(H;n U RR+S S5 U RR+S S5 M= [-X5 U(d [/U5 Sn URR H)n U R S:XdMU RU:XdM'U n M+ U c[SUSURS35eU cS US UR35eXi4$!,(df  N=f)a Modifies the given graph module in-place to separate out the given nodes into a submodule. The given node_list should form a fully connected subgraph. Args: gm: The graph module that we want to partition node_list: A list of nodes that belong in the partition Returns: The submodule that has been partitioned, the call_module node in the toplevel graph module calling the submodule fused_N call_modulez!The submodule created with nodes z did not form one fully contained subgraph. Check that these nodes form a fully contained graph. Partitioned graph: .rrrtnn_module_stacksource_fn_stackz(No submodule was created with the nodes z in the graph )r)r%rr&rFrrr|rrrr2rinserting_afterrrrrreplace_all_uses_withrvrpopr$r') rrrr sorted_nodessubmodule_namesub_gm orig_inputs orig_outputssubmodule_noder proxy_out user_nodes r?create_submodule_from_nodesr0s6&Y'L^N(; .)%Fv b+ >I  0 0 ;$2$7$7$>INN5 !,a0IN 6 5(--I NN  0$ 7 NN  0$ 7.! rN 77m # ~(E!N/ {;779xxj C   "V 1)N288*UV"  !!S6 5s *A#H?? I rOc/nURRHdnURS:XdMUR[:XdM+[ XS5up4n[ U[5(deURX4U45 Mf U$)a- Returns a list of lowered modules that are in the given graph (does not look into submodules). Specifically, the returned value is a list containing a tuple of (name of the lowered module that's stored in the graph module, the lowered module itself, and the fx node that called this lowered module). rr) rFrrr|rrrr+r)rOlowered_submodulesrrxmodules r?get_lowered_submodulesr4Esx""(( 77o %$++9Q*Q!/ A!F D$f&:;; ;;  % %tT&: ; ) rAc/nURRH^nURS:XdMUR[:XdM+[ XR SR5nURU5 M` U$)zL Returns a list of exported programs which were lowered by backen delegates rr) rFrrr|rrQrvrxr)rOlowered_programsrlowered_backend_modules r?get_lowered_backend_modulesr8Wsh ""(( 77o %$++9Q*Q%,\99Q<;L;L%M "  # #$: ;) rAcall_delegate_noderrc URRVs/sH!nURRU;dMUPM# snURlURRVs1sHnUR cMUR iM nnURR Vs/sH!nURRU;dMUPM# snURlURRH]nURS:XaJURU;a8[UR5S:XdeURRU5 M[M] O UR5HnUR nUceX;aMUR[R :XaUR"U MHUR[R$:XaHUR&(aUR"R)US5 MUR*UR MUR[R,:XaUR*UR M[/SUS35e URR15n U ce[U R25S:XdSU SU R235eU R2SV s/sH@n [5U [6R8R:5(aU RU;dM>U PMB n n [=U 54U l/n [?URRA55n U HnURU;dMURS :XaUR [BRD:Xd$S US WRS UR 35eUR2Sn[5U[F5(dS [IU535eU RKU5 URRU5 M U RMSS9 [?URRA55n U HnURS :XaUR [BRD:XdeUR2Sn[5U[F5(de[OU 5H4unnUU:dMUR2SU[U 5U- - 4Ul M M gs snfs snfs snfs sn f)z Directly modify the original exported program's signature and state dict based on the consumed params/buffers in the delegate. NrsrrrrzInvalid output node: z with args rrrrrT)reverse)(rGr~r{rx_graph_signaturer|rrFrrrrrvaluesrzrr _state_dictr persistentr' _constantsrrrrvrrrrrrrrrrrrsortr)rr9rrrcurrently_used_targetsr rr toplevel_output_noder{new_output_args getitem_idxs user_nodesr user_idxridxs r?_unsafe_adjust_original_programrIfsu+::FF5FJ >>  &; ; F5%%1+;;GG(GJ     G(,;;HH6HK ??  '= = H6%%2!&&,, 77m #yy114::!+++ &&11$72  -,224 !(( '''  1  ??i11 1 ,,\: __ 0 0 0$$ ,,00tD$// 0A0AB __ 9 9 9 ++J,=,=>!4ZL JK K#5(,11==?  ++ + % %&!+\ 34K@T@Y@Y?Z[\+ (,,Q//C#uxx}}--AW1W / "'!7 9!L(..3356J 99. .?*t{{h>N>N/N ]tfM$'':Nt{{m\ ]Nyy|Hh,, W0FtH~FV.W W,    )  " " - -d 3d#(..3356Jww/)dkkX=M=M.MMM99Q<(C(((( -FAs#~!YYq\8s<7H17L+MN . _5 ( 6Vs.S%S%+S*S**S/ S/=S4S4)F)QrMr collectionsrtypingrrrrrr r rtorch.utils._pytreeutils_pytreerexecutorch.exir._serializer r ,executorch.exir._serialize._named_data_storer +executorch.exir.backend.compile_spec_schemarexecutorch.exir.delegaterrexecutorch.exir.emitrexecutorch.exir.graph_moduler+executorch.exir.passes.memory_planning_passr%executorch.exir.passes.spec_prop_passrrexecutorch.exir.schemarexecutorch.exir.tracerr"torch._library.fake_class_registryrtorch._subclassesrtorch.export.exported_programrrrrrrr r!r"r#!torch.fx.passes.utils.fuser_utilsr$r%r&r'r(r)nnModuler+r GraphModulerrrrrTensor Parameter ScriptObjectrrr0r4r8rIrrAr?rcs #??? $$FMCV-7JI*(?(   o5588??o5f 588//D(D D.=D XXDZ a%a ahhmma a  a  eELL%(("4"445 56eELL"2E4F4FFG GHij  aH@xx##@#@ @hhmm @  @  ?Di0$sJ2G GH @N!& V" V"V" V" V"  588   ./ V"r((&& %)588==8 9:$ ((&&   `%` ` Y/`!j1 `  `rA