ieDSrSSKrSSKJr SSKJrJrJrJr SSK r SSK r SSK J r SSKJrJr SSKJr SSKJrJrJr SS KJr SS KJr SS KJrJr SS KJr SS K J!r! SSK"J#r# SSK$J%r% SSK&J'r'J(r(J)r) \RT"\+5r,S\'S\\-\.44Sjr/S\(S\0\-\.44Sjr1S\)4Sjr2S\-4Sjr3\"SS\55r4g)aProvide TOSA backend entry points for the Arm ExecuTorch integration. Implement the Ahead-of-Time (AoT) preprocessing path that lowers an ``ExportedProgram`` to a TOSA flatbuffer using Arm's lowering pipeline. Use this module either as a standalone backend that produces a TOSA artifact or as part of a composed pipeline for hardware backends that consume TOSA as an intermediate form. Use ``TOSABackend.preprocess`` to return the serialized TOSA flatbuffer that subsequent stages (for example, JIT or hardware-specific compilers) consume. N)count)castDictfinalList)ArmCompileSpec) debug_faildebug_tosa_dump) DebugHook)process_call_functionprocess_outputprocess_placeholder)TosaCompileSpec)TOSA_TENSOR_NAME_META)BackendDetailsPreprocessResult) CompileSpec)get_memory_format)get_cond_while_submodules)ExportedProgram)Graph GraphModuleNodeep_graphreturnc^0nU4SjmUR5n/nT"URSU5 [U5VVs0sHupEURU_M nnnU$s snnf)aPAssign deterministic output IDs to leaf outputs. Flattens the output structure and assigns the external ID based on the leaf position in the exported output tuple/list. Args: ep_graph (Graph): FX graph produced by export preprocessing. Returns: dict[str, int]: Mapping from *leaf output node name* to external output index. c>[U[5(aURU5 g[U[[45(aUH nT"X!5 M gg)N) isinstancerappendlisttuple)argnodesa_collect_leavess c/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/executorch/backends/arm/tosa/backend.pyr%/_annotate_external_ids.._collect_leaves=sF c4 LL  dE] + +),r) output_nodeargs enumeratename)rnode2external_idout out_leavesidxleafr%s @r&_annotate_external_idsr2.sl*    CJCHHQK,9B*8MN8M93 38MN OsA graph_modulenode_to_id_mapc^^^ S[S[S[4Sjm URR5n[ [ UR S5n[5mS[S[4UU U4Sjjn[ [X4S95n[ U5nXV:waa[UR S[5(a [U5OUnU4UlURR5 UR5 U$) aReorder graph outputs to match ascending external IDs. Args: graph_module (GraphModule): Graph to reorder in place. node_to_id_map (dict[str, int]): Mapping from node name to output index. Returns: GraphModule: Updated graph module with deterministic output ordering. nfallbackrc:URURU5$)z=Return the external ID for ``n`` or ``fallback`` when absent.)getr,)r6 node_2_idr7s r& _external_id#_sort_outputs.._external_id]s}}QVVX..r(rtc*>T"UT[T55$)z._sort_keyfsA~tH~>>r()key) rintgraphr)rr!r*rsortedrr lint recompile) r3r4out_nodeout_listrAorig_ord current_order replacementr@r;s ` @@r& _sort_outputsrNQs//3/3/!!--/HE8==+,HwH?T?c??VH45H(OM (28==3CT(J(Jd8nPX $ ! r(nodecURSnURSnUR[[U55S9$)zlReturn a fake tensor with the same properties as node, but with .dim_order() == node.meta["tosa_dim_order"] valtosa_dim_order) memory_format)metatorr )rO fake_tensordesired_dim_orders r&_get_matching_fake_tensorrXvs?))E"K "23 >>(9$?P:Q(R> SSr(cURRH)nURRS5nU(dM'Us $ [R S5 g)zReturn the first delegation tag discovered in the FX graph. Args: graph_module (GraphModule): Module produced by Arm partitioning. Returns: str: First non-empty delegation tag or an empty string when no tag is recorded. delegation_tagz%No delegation tag found in partition.)rEr#rTr9loggerdebug)r3rOtags r&arm_get_first_delegation_tagr_sI""((iimm,- 3J)  LL89 r(c\rSrSrSr\S\S\\4Sj5r \S\S\ S\ 4Sj5r \S \ S \4S j5r\SS \ S\S\ S\R"S\S -S\S -S\ S -4Sjj5r\S\S\ 4Sj5rSrg ) TOSABackendzProvide a backend for lowering programs to TOSA. Use this class standalone to produce a TOSA representation, or as part of a composed pipeline for hardware backends that consume TOSA. edge_program compile_specscV[RU[R"U55$)aCConvert an exported program using the provided compile specs. Args: edge_program (ExportedProgram): Program generated by Torch export. compile_specs (List[CompileSpec]): Raw compile specifications from ``executorch.apply_backend``. Returns: PreprocessResult: Result containing serialized TOSA bytes. )ra _preprocessr from_list)rcrds r& preprocessTOSABackend.preprocesss'&& /33MB  r( compile_specrcNUR5nURnURnSnUb [U5n[R SU35 U(dSnUR n[R"UURURURURS:aSOSS9nUR R[R:Xa(UR R[R::d0[S[RS [RS U35e[R!UR"UUUU5 UR%5nU(a['UR"5n [)UUS R+U (aS U 3OS5S U3-S 9 UbaUR,[.R0R2:Xa9UR%5n [5US3S5n U R7U 5 SSS5 [9US9$!,(df  N=f)aLower an exported program to a TOSA flatbuffer. Apply Arm transformation passes to ``edge_program``, then walk the transformed FX graph to emit a TOSA graph via the serializer. When requested in ``compile_spec``, write additional debug artifacts. Args: edge_program (ExportedProgram): Program to lower to TOSA. compile_spec (TosaCompileSpec): Backend options. Recognized keys: - output_format: Must be "tosa". - tosa_spec: Target TOSA version/capabilities. - debug_artifact_path: Directory for debug outputs. - compile_flags: Optional backend flags. - dump_debug_info: Enable extra debug JSON dump. Returns: PreprocessResult: Result containing processed_bytes with the serialized TOSA flatbuffer. Raises: ValueError: If output_format is not "tosa" or the TOSA specification is missing from compile_spec. RuntimeError: If an unsupported FX node type is encountered. Nz$Converting ExportedProgram to TOSA: r[rTF) targetMajor targetMinor targetPatch targetDraftzTOSA serializer version (.z) doesn't match specification z{}_)suffixz /debug.jsonw)processed_bytes)get_intermediate_path tosa_spectosa_debug_moder r\infoversiontsTosaSerializermajorminormicroTOSA_VERSION_MAJORTOSA_VERSION_MINOR RuntimeErrorra_preprocess_moduler3 serializer_r formatmoder DebugModeJSONopenwriter) rcrj artifact_pathrvdump_debug_info debug_hookry tosa_graphbinaryr^ json_outputfs r&rfTOSABackend._preprocesss>%::<  ** &66  &"?3J :9+FGM##&&    '  1u      # #r'<'< <!!''2+@+@@))*!B,A,A+BC//8k;  &&  % %      %%' .|/H/HIC {{Qse9&>&C&CC","6"6"8K{;SAQ ,B 77BAs 3H H$ submodulesubmodule_nodec /nURRH5nURS:XdMSURS'UR U5 M7 UR =[ RRR:Xa& [[[URS5nO[ RRR:XaC[[[URS5[[URS5-nO[SUR 35e[!X$SS9HupV[#U5URS'M URR%5n['URS [5(a UR)S URS /5 [[[URS 5n[!XR*5Hup[#U 5U RS'M g ) apTo make a submodule fit into the normal flow of a graph_module, we need to do some regularizations. - Buffers created before passes are treated as input to the submodule. Buffers created during passes are treated as "normal" buffers, i.e. gathered from the state_dict. To make it easy to tell them apart, mark all placeholders with "is_input = True" before running passes. - Make sure output node args[0] is always iterable. - Match the dim_order() of the input tensors with the dim orders of the submodule_node inputs. - Match the dim_order() of the out tensors with the dim orders of the submodule_node outputs. placeholderTis_inputz Unexpected control flow target: )strictrQrN)rEr#oprTrtargettorchops higher_ordercondrr rr* while_looprziprXr)r update_argusers) rrsubmodule_inputsrOr*submodule_input submodule_argr) output_argssubmodule_outputsubmodule_users r&_regularize_submodule!TOSABackend._regularize_submodules(*OO))Dww-'(, *% ''-*##,'',,DJ(;(;B(?@''22DJ(;(;B(?@4.--b1D"6~7L7L6MN/22BQU.V *O*CM*RO  '/W oo113 k&&q)4 0 0  " "1{'7'7':&; <4:{'7'7':; 14KAUAU0V , +D^+T  ! !% (1Wr(Nr3rrsubmodule_namecontaining_graph_modulec 6URn[UR5nUR5n UR 5n SSKJn U "U5RXS9nSSKJ n U "XU5n U (a![RS5 [X5nO[RS5 Ub`URU5 URRU5 SU3nURR HnXR"[$'M URR GHn['[(U5nUR*S :Xa[-UX=U5 M4UR*S :Xa/[/UR05S:XaUcMb[3UUUUU5 MsUR*S :Xa[5UX75 MUR*S :XaP[7U[9UR:5S5nUc [=S 5e[?U[@5(d [=S5eM[=URBSUR*35e [IU5H6unnn[JRMUU5 [JROUUUUUUUS9 M8 g![Da [GUXU 5 ef=f)a#Convert an FX ``graph_module`` to TOSA serializer calls. Args: graph_module (GraphModule): Module to lower recursively. edge_program (ExportedProgram): Original exported program. compile_spec (TosaCompileSpec): Backend options with TOSA settings. tosa_graph (ts.TosaSerializer): Serializer receiving operators. debug_hook (DebugHook | None): Optional debug instrumentation. submodule_name (str | None): Name used when visiting nested blocks. Raises: RuntimeError: If an FX node with an unsupported op kind is found. r)ArmPassManager)exported_programr3)get_node_visitorsz(Re-sorting outputs during TOSA lowering.z8No re-sorting outputs (workaround) during TOSA lowering.Nrq call_functionroutputget_attrz8get_attr node is not targeting anything in graph module.z-get_attr node is not targeting a GraphModule.z is unsupported op )rr)(rvr2rEruget_output_order_workaroundexecutorch.backends.arm._passesrtransform_to_backend_pipeline.executorch.backends.arm.operators.node_visitorrr\r]rN startRegion currRegion addBasicBlockr#rTrrrrr lenrrr getattrstrrrrrr, Exceptionr rrarr)r3rcrjrrrrrvr4routput_order_workaroundrr node_visitorsrr loop_noderOattrr,rcontrol_flow_nodes r&rTOSABackend._preprocess_module2s~0!** / 0B0BC$::< "."J"J"L C%l3QQ)R U),:N " LLC D(FL LLS T  %  " "> 2  ! ! / / ?()F)//55 8>456!&&,,Dd#D$ 77o-)$ 9UWW -4::!+0F!'"$/! WW("4?WW *"<T[[1A4HD|*V&dK88*K9'$))4Gy'QRRG-R3L 3 .D).  - -i9J K  * *#(4 +  3  4=I s+7I?,I?I?I?3AI?$I??JcUR5n[UR5nURU5 UR UR 55R UR5RUR5$)a&Extract the TOSA-specific settings from a composite compile spec. Args: compile_spec (ArmCompileSpec): Compile specification that may include both TOSA and hardware-specific options. Returns: TosaCompileSpec: TOSA-only specification ready for ``TOSABackend.preprocess``. ) get_pass_pipeline_configrrvset_pass_pipeline_configdump_intermediate_artifacts_torurrwset_output_order_workaroundr)rjpipeline_configtosa_compile_specs r&filter_tosa_compile_specs%TOSABackend.filter_tosa_compile_specsss '??A+L,B,BC22?C  < <224 _\99 : ( ()M)M N  r()NN)__name__ __module__ __qualname____firstlineno____doc__ staticmethodrrrrhrrrfrrrrzr{r rrrr__static_attributes__rr(r&raras)  kAR  W8%W8%W8 W8W8r(U(Ud(U(UT&*6:j!j%j&j%% j $ j d j"-t!3jjX $   r(ra)5rlogging itertoolsrtypingrrrrrtosa_serializerrz/executorch.backends.arm.common.arm_compile_specr$executorch.backends.arm.common.debugr r $executorch.backends.arm.debug.schemar $executorch.backends.arm.process_noder r r)executorch.backends.arm.tosa.compile_specr$executorch.backends.arm.tosa.mappingr'executorch.exir.backend.backend_detailsrr+executorch.exir.backend.compile_spec_schemarexecutorch.exir.dim_order_utilsrexecutorch.exir.graph_modulertorch.export.exported_programrtorch.fxrrr getLoggerrr\rrDr2dictrNrXr_rarr(r&rs ** JL: FFTC=B9--   8 $ U tCH~ F" "T#s(^"JTDT#(d .d d r(