i3}%SSKrSSKrSSKJrJr SSKJr SSKJr SSK J r J r J r J r SSKrSSKJrJr SSKJr SSKJrJr SS KJrJr SS KJrJr SS KJr SS KJ r J!r!J"r"J#r# SS K$J%r%J&r& SSK'J(r(J)r)J*r* SSK+J,r,J-r-J.r. \S5r/\/R`S\1S\,S\ \S\#4Sj5r2Sq3\4\5S'S7Sjr6\S\ S4Sj5r7S\RpRrS\1S\,S\ \RpRt4Sjr;S\,S\,S \RpRtS!\RpRtS"\#S#\4S$\ \1\-4S%\ \1\.44S&jr\/R`S\,S*\S\,4S+j5r2S\RpRrS'\S\,S#\4S\ \1\ \RpRt44 S,jr?S8S\RpRrS'\S\,S#\4S\ \1\ \RpRt44 S-jjr@S\1S.\ \1\ \RpRt4S/\ \1\,4SS4S0jrAS1\RpRSS4S2jrC\"S3S455rD\/R`S5\DS\ \1\,44S6j5r2g)9N)contextmanager nullcontext) dataclass)singledispatch)Dict GeneratorListMapping)BackendDetailsPreprocessResult) CompileSpec) PartitionerPartitionResult)_maybe_duplicate_constant_nodesis_identical_graph)executorch_call_delegateget_lowered_module_name)get_control_flow_submodules)_unsafe_adjust_original_program&create_exported_program_from_submodulecreate_submodule_from_nodesLoweredBackendModule)get_fake_programupdate_to_real_program) is_bufferis_lifted_tensor_constantis_param)ExportedProgram InputSpec OutputSpeccg)a A generic function the dispatch happens on the type of the first argument. There are currently to overloaded to_backend function: Note: Python is dynamically-typed language and therefore cannot have proper method overloading as that requires the language to be able to discriminate between types at compile-time. @to_backend.register will attach the function to to_backend() base on the type of the first argument (type annotation is required). However, it can't take multiple types as arguments. :: def to_backend( backend_id: str, edge_graph_module: ExportedProgram, compile_specs: List[CompileSpec], ) -> LoweredBackendModule: def to_backend( edge_program: ExportedProgram, partitioner: Partitioner, ) -> ExportedProgram: N)argss b/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/executorch/exir/backend/backend_api.py to_backendr%+s, backend_id edge_program compile_specsreturnc [U[5(de[R"5HnXR:XdM[ R "U5nURUU5n[UUURUURS9nSUR0Ul URbURURS'Us $ [SUS35e)a Add overloaded implementations for to_backend: :: def to_backend( backend_id: str, edge_program: ExportedProgram, compile_specs: List[CompileSpec], ) -> LoweredBackendModule: Requires the passed in exported program in Edge dialect to be executed in the backend identified by backend_id. The forward method of the given edge_graph_module will be targeted for execution. Args: backend_id: The backend identifier. exported_program: An exported program in Edge dialect to target for lowering to the backend. compile_specs: A list of backend-specific objects with static metadata to configure the "compilation" process (e.g. it could be another dictionary itself). Returns: LoweredBackendModule: A Module that has been lowered to the target backend. Internally, the lowered Module contains these special attributes: backend_id (str: backend id), __processed_module__ (str: a compiled module) compile_spec, original_module (original exported program) Raises: NotImplementedError: The backend is not implemented (e.g. it was not found). This exception is derived from RuntimeError and should be caught accordingly. RuntimeError: The module cannot be processed by the backend. r(r'processed_bytesr)named_data_store_outputdebug_handle_map_delegate_info_metaBackend  was not found.) isinstancerr __subclasses____name__copydeepcopy preprocessrr-data_store_outputr/metar0NotImplementedError)r'r(r)clscopied_edge_programpreprocess_resultlowered_modules r$_r@DsR lO 4 44 4,,.  %"&-- "= 25..#3 2)% 1 A A+(9(K(K N#$5$F$F#N !44@%99##$9:" !+/,  OD EEr&T_ENABLE_VALIDATIONcSqg)zDisables validationFN)rAr"r&r$disable_validationrCs r&)NNNc#H# [n[5 Sv Uqg!Uqf=f7f)a Disables checking functions (ex. if the partitioned graph is identical to the original graph). This context manager should only be used in certain scenarios (such as when it has been profiled that checks are taking too long, and are not necessarily needed) N)rArC)existing_settings r$validation_disabledrFs(*. --s"""tagged_graph_moduletagowning_programc /nURRHnURRSS5U:XdM%URS:Xa[ SUS35eURS:Xa[ X$5(d/[X$5(d[X$5(d[ SUS35eURH<nURRSS 5nXa:wdM&[ S US US US US3 5e URU5 M U$)z+ Return a list of nodes with the same tag. delegation_tagoutputz output node z should not be tagged placeholderz\placeholder node for non-params, non-buffer, and non-tensor constants should not be tagged:  Nzconstant data node (z) is tagged with (z) but has user (z) which has tag ()) graphnodesr:getop RuntimeErrorrrrusersappend)rGrHrI node_listnodeuser users_tags r$_get_node_list_with_same_tagr\s&I#))// 99==)2 .# 5ww(""\$7L#MNNww-' 66%n;;5nKK&vw{v||}~ !% $(IIMM2BD$I $+"."6tf.generate_debug_handlesG OO))//D|YY]]>1-MNL0ar&rfrval)rQ owning_moduler#r3torchfxNodenamekeysrWrintinserting_beforerget_attr call_functionrtuplekwargsr:replace_all_uses_with erase_nodelenr)r]rIr^r_r?r`rarbowning_graph_modulecall_delegate_argsinput_specs_to_delete call_sm_inputrj lowered_name lowered_nodecall_delegate_nodeout_args r$_insert_lowered_submodulers.33AA:,11 }ehhmm 4 4""&;&@&@&BB !!-0 2 / c   " " 3 34G H./BS *0099,G 066DD $ Oe$67 7  & &  3H2W//D/I/I!/L* /LGGLL /L* & 112DE!!,,-@A I12a77723q888 *+a/ . /! 3'   * +   4*  I Hs4BG39G.Q  MM;C5A B  ^I;?@  1 1..??A  *E#+ 'I +>*C*C*O*O*Q' ) ; ; =&E%I%I" 23F2GHI 3         * +'  & &   ) )  "    !   * +    "{!H~ U[s /F F c[XX#5n[U5H"upVn[XaUSS9nURXX5 M$ U$)z Partitions the graph module into submodules based on tags, and then lowered the nodes with the same tag as one lowered module, including the submodule from control flow Tr`)rr_partition_and_lower add_module) rGrrIr`partitioned_modulerqsubmod_nodepartitioned_submodules r$rrQsV?~ ;;MNe 4 n4!  &&tC O r&partitioner_instancec UR5 [U5nU"U5nURn[(a1[UR UR 5(d SUS35eO[R"S5 URc SUS35e[XP5 URR5Hupg[XV5 M [UR UU5nUR R"Hn U R$R'S S5 M! [)UUR UR*UR,[ R"UR.5[ R"UR05SUR2UR4/S 9 $![aGn[R"SUR SU35 [ R"U5nSnAGNSnAff=f) a Add overloaded implementations for to_backend: :: def to_backend( edge_program: ExportedProgram, partitioner: Partitioner, ) -> ExportedProgram: Returns a semantically-equivalent program to the one given as input (represented as a graph module in Edge dialect), but with portions of the program targeted for delegation as determined by the partitioner. Args: ExportedProgram: Program in Edge dialect. partitioner: An instance of the partitioner, in charge with tagging portions of the input program for delegation. A valid partitioner must return PartitionerResult including both tagged exported program and partitioner_tag: Dict[str, DelegationSpec], where each key is a tag name and the nodes with same tag will be fused a one subgraph and delegated to backend specififed in delegation spec. Returns: ExportedProgram: The input program, with some portions targeted for delegation. $Error in get_fake_program for graph , fallback to deepcopy: NThe partitioner # should not modify the graph module$Disabled validating the partitioner. Partitioner M needs a `partition_tags` field containing a mapping of tags to delegate specrK rootrQr state_dictrange_constraintsmodule_call_graphexample_inputs constants verifiers)rr Exceptionrwarningrhr6r7tagged_exported_programrArrrrrrrQrRr:poprrrrrrverifier) r(rfake_edge_programepartitioner_resultrrHr@rGrYs r$r@r@is>8,\: ..?@0HH! # 0 0  % %   X233V W X >? ))5z *++xyz52A$3399;'(?E</,,$))// &-0  !''/??*55--(?(Q(QR--(?(Q(QR)33*334  K 82<3L3L2MMefgeh i !MM,7 8s F$$ G5.Q  MM;C5A B  ^I;?@  1 1..??A  *E#+ 'I !* ; ; =  23F2GHI 3         * +/>.H.Hl+0?0M0Mn-5F12 * >? , ?@1=n-9N56  % %-I IGI ()C)C D %%?%?@GG  # # y!H@3O2S2S2UV2U3Bw2UV&B&H&H&J" N'--33Dww-'DKK>,I' 3::4@4'K .224 *:673 ( 4<    5 #"o[VWs1J$ J, J) c[XX#5n[U5HIupVn[XaUSS9nUR5H$unn X;aXU'MXHR U 5 M& MK U$)NTr)rr_create_partitionsrextend) rGrrIr`backend_id_to_call_submodulesr@r$nested_backend_id_to_call_submodulesr'nested_submoduless r$rrs %G~%! 44GH 1/A n40 , 2 7 7 9  >r^rr]r?r`rarbr_s r$lower_all_submodules_to_backendr1s 2L1Q1Q1S % 2T -K - - MM$))$78 9,  2T "%2L1Q1Q1S1S -K -G9G>. H :HH 4H9G>H rQcURHnURRSS5 URRSS5 URRSS5 URRSS5 URRSS5 URRSS5 URRSS5 M g) z* Remove the used metadata from the graph. rKNr'r]rarbr`r_)rRr:r)rQrYs r$remove_used_metadatars  &- lD) )40 6= 7> nd+ -t4r&cB\rSrSr%Sr\\\4\S'\\\ 4\S'Sr g)MethodProgramsPartitionerSpeciz Since single dispatch for to_backend requires the first argument to be a valid class, we create the following dataclass spec to hold the dictionaries mapping the method name to the corresponding program, partitioner method_to_edge_programmethod_to_partitionerr"N) r5 __module__ __qualname____firstlineno____doc__r strr__annotations__r__static_attributes__r"r&r$rrs) $C$899"3 #344r&r method_edge_program_partitionersc URnURn0n0n0nUR5GH5upgXa;d SUS35eXnUR5 [ U5n U"U 5n U Rn XU'[(a1[U RUR5(d SUS35eO[ R"S5 U Rc S US 35e[X5 U RR5Hup[!X5 M [#U RU U 5nUR5HunnUU;a0UU'UUUU'M GM8 UR5Hunn[%UUU5 M UR'5HnXe;aXVn U R5 [)U RR*5 [-U RU RR*U R.U R0[R"U R25[R"U R45SU R6U R8/S 9 X6'MXX6'M U$![ aGn [ R"SURSU 35 [R"U5n Sn A GNfSn A ff=f) a[ Add overloaded implementations for to_backend: :: def to_backend( method_edge_program_partitioners: MethodProgramsPartitionerSpec ) -> Dict[str, ExportedProgram]: Returns a semantically-equivalent dictionary of programs to the programs given as input (represented as a graph module in Edge dialect), but with portions of the program targeted for delegation as determined by the partitioner. Args: method_edge_program_partitioners: contains two mappings, - method_to_edge_program: mapping of method names to their respective programs in Edge dialect. - method_to_partitioner: mapping of method names to an instance of the partitioner, in charge with tagging portions of the specified program for delegation. A valid partitioner must return PartitionerResult including both tagged exported program and partitioner_tag: Dict[str, DelegationSpec], where each key is a tag name and the nodes with same tag will be fused a one subgraph and delegated to backend specififed in delegation spec. Returns: ExportedProgram: The input program, with some portions targeted for delegation. zPartitioner for method z is not providedrrNrrrrrr)rrrrrrrrrhr6r7rrArrrrrrrrrrQrrrrrrr)rrr)partitioned_and_lowered_exported_programs#backend_id_to_method_submodules_map!method_to_tagged_exported_programrrr(rrrrrHr@"backend_id_to_call_submodule_nodesr'rmethod_to_submodule_nodess r$r@r@s:>TT<RR02-*,'(*%-B-H-H-J)  1 C $[M1A B C 1-:   < 0 >  22CD"4"L"L9P+6  %'44)) \""6!77Z[ \ OOB C  - - 9 ~ .//| } ~ 9 6E(77==?FC +,C I@.@ # 0 0  #. *0 5 5 7  !DDBD3J?% 0 ; 8].Kp - 2 2 4 !'  % -  5.224  ;&G&T # # - - / !8!E!E!K!K LET,99-::@@ 7 G G2=="&--+==##'--+==# $1;;2;;<F 5 B$'3 6 B-54 54] < OO6|7P7P6QQijkilm !% l ;   rs 2!$11 TCL WD ONPP  0 AFAF!AF $AF AFAFH D  .Y'78 . . --   $  %((-- F= &= #= = !88== = ) =  = %)i$8= &*#z/%:= @H--H%H$H H  XX H^ --%$   XX 0 S!S%SSSlS#--S#%S#$S# S#  #tEHHMM" "# S#t )--)%)$) )  #tEHHMM" "# )6OO $S$uxx}}*=%= >O$(_(<#=O Od 5 54 5 55 5 |5&C|5 # |5|5r&