iFFSrSSKrSSKJr SSKJrJrJrJrJ r SSK r SSK J r SSK Jr SSKJr SSKJrJr SS KJr SS KJr SS KJr SS KJrJrJr SS KJrJ r SSK!J"r# SSK$J%r% SSK&J'r' SSK(J)r) SSK*J+r+J,r, SSK-J.r. \R^"\05r1S\ RdRfRhS\54Sjr6S\ RdRhS\54Sjr7S\ RdRhS\54Sjr8S\ RdRfRhS\54Sjr9S\ RdRfRhS\54Sjr:S\ RdRfRhS\54Sjr;S\ RdRhS\"S"S#\5r?g)$aProvide a partitioner for delegating subgraphs to the TOSA backend. Implement logic to identify and tag regions of an ``ExportedProgram`` that can be delegated to the TOSA backend. Use this module to: - Partition graphs based on operator support and additional checks. - Prune trivial no-op partitions that would lower to empty TOSA graphs. - Tag constant data and report reasons for rejected nodes. N)count)CallableListOptionalSequenceTuple)get_first_fake_tensor)calculate_multiples) ensure_type)DQ_OPSQ_OPS)tosa_support_factory) TOSABackend)TosaCompileSpec)DelegationSpec PartitionerPartitionResult)tag_constant_dataWhyNoPartitionReporter)ops)get_cond_while_submodules)ExportedProgram) GraphModule)CapabilityBasedPartitioner Partition)OperatorSupportBasenodereturncxUR[RRRR :H$N)targetexir_opsedge dim_order_ops_clone_dim_orderdefaultrs g/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/executorch/backends/arm/tosa/partitioner.py_is_noop_cloner)1s' ;;(--55FFNN NNcxUR[RRRR :H$r )r!r"r#aten alias_copyr&r's r(_is_noop_alias_copyr.5s' ;;(--,,77?? ??r*cxUR[RRRR :H$r )r!r"r#r, detach_copyr&r's r(_is_noop_detach_copyr19s' ;;(--,,88@@ @@r*c@UR[RRRR :wag[ [RRURS5nURRS5[U5R:H$)NFrdtype)r!r"r#r$_to_dim_order_copyr&r torchfxNodeargsmetagetr r3)r input_nodes r(_is_noop_to_dim_order_copyr<=sg {{hmm11DDLLL  ! = yy}}W%)>z)J)P)PPPr*cUR[RRRR :wag[ UR5up[SU55=(a U(+$)NFc3*# UH oS:Hv M g7f)N).0ms r( "_is_noop_expand..Js)y!Avys) r!r"r#r, expand_copyr&r r8all)r multiples changes_ranks r(_is_noop_expandrIEsQ {{hmm((44<<<"5dii"@ )y) ) >,.>>r*cxUR[RRRR :H$r )r!r"r#r, view_copyr&r's r( _is_view_copyrLMs' ;;(--,,66>> >>r*tagcRSUR;=(a URSU:H$)zReturn True if the node currently belongs to the partition ``tag``. Args: node (torch.fx.Node): FX node to check. tag (str): Delegation tag identifying the partition. Returns: bool: True if the node carries the matching delegation tag. delegation_tag)r9)rrMs r(is_partitionedrPQs' tyy ( OTYY7G-HC-OOr*reason partitionreportercURH4nSUR;dMURS URUU5 M6 g)a+Remove a proposed partition and record the rejection reason. Args: reason (str): Human-readable explanation for rejection. partition (object): Proposed partition object from the capability partitioner. reporter (WhyNoPartitionReporter): used to report why nodes were rejected. rON)nodesr9 report_reject)rQrRrSrs r(reject_partitionrWbs? tyy ( *+  " "  r*c \rSrSrSrSS\S\\\SS4Sjjr S\ S \ S \ SS4S jr SS\ S \S \ S \S-S\\ 4 SjjrS\S\4SjrS\S\\\R.R0\\\R4R6/\444SjrSrg)TOSAPartitionerwa Partition an exported program into TOSA-delegable subgraphs. Construct this partitioner for compile specs targeting TOSA. The partition algorithm uses capability checks and optional additional operator-support rules to tag nodes with a delegation tag per subgraph. N compile_specadditional_checksrc[[RUR55UlUR UlX lg)axInitialize the TOSAPartitioner. Args: compile_spec (TosaCompileSpec): Parsed compile specifications for TOSA containing the TOSA spec and original list. additional_checks (Optional[Sequence[OperatorSupportBase]]): Extra operator-support checks to apply when partitioning. Raises: RuntimeError: If the provided compile spec does not target TOSA. N)rr__name__to_listdelegation_spec tosa_specr\)selfr[r\s r(__init__TOSAPartitioner.__init__s:" .  ,"6"6"8 &//!2r*modulerMrSc^URRGH6n[UT5(dMUR[;nUR[ ;nU=(a [UR ST5(+nU=(a [U4SjUR55nU(dU(aURS MU(aMU(aMUR Hkn [U T5(aM[U 5RR(dM<URUSU RS35 URS GM4 GM9 g)aDe-tag nodes at the partition boundary. Remove delegation tags from quantize nodes with inputs outside the partition and from dequantize nodes with outputs outside the partition. For non Q/DQ nodes, remove the tag from the first node in the partition if any input has floating-point dtype. Args: tag: The delegation tag assigned to the partition. reporter: A reporter to log rejected nodes. module: The GraphModule containing the partition. rc3F># UHn[UT5(+v M g7fr )rP)rAuserrMs r(rC8TOSAPartitioner._detag_boundary_nodes..s!5:D$N4---*s!rOz&Was first node in partition and input z had fp dtype.N)graphrUrPr!r r all_input_nodesanyusersr9r r3is_floating_pointrVname) rbrerMrSr is_q_node is_dq_nodeis_boundary_q_nodeis_boundary_dq_nodeinputs ` r(_detag_boundary_nodes%TOSAPartitioner._detag_boundary_nodess(LL&&D!$,, u,I.J!*">$$Q'40 #-#5:>**52 "%8II./Yzz!11E%eS11 ,U399KKK .. DUZZLP^_!II&672''r*containing_program tag_iteratorc[5nUc [S5n[U5H8upgnURXrX45n[ XX-5S:wa [ S5eXX-nM: [ URX#UR5n [UU SS9n U R5n U Hn S[U53n URU 5 U RHnXRS'M URR5(a2URR!5(dUR#UU U5 [%SU R55nU(dM['SU U5 UR)U 5 M U$) aGTag nodes in a module or submodule from the containing program. Args: module: A GraphModule from `containing_program` to tag nodes in. containing_program: The ExportedProgram that contains the module. reporter: A reporter to report why nodes were rejected. Returns: A set of strings with the partition tags. rzEGot overlapping tags in two different modules, this shouldn't happen.T)allows_single_node_partitionrMrOc30# UHn[U5=(du [U5=(dc [U5=(dQ [U5=(d? [ U5=(d- UR [ ;=(d UR [;v M g7fr )r)r.rIr<rLr!r r )rArs r(rC.TOSAPartitioner._tag_module..s ),Dt$)&t,)"4().d3)!& ) ;;%' ) ;;&( ),sBBzcPartition contained only ops which are removed in the TOSA lowering, leading to an empty partition.)setrr _tag_modulelen RuntimeErrorrrar\rpropose_partitionsnextaddrUr9support_integer support_floatrurFrWremove)rbrerwrSrxtags_ submodulesubmodule_tagsoperator_supportcapability_partitionerpartition_listrRrMris_nocompute_partitions r(r~TOSAPartitioner._tag_modules$   8L8@OA!!--xN4()Q."[(D A0 NN.$:P:P "<  )-"  0BBD'I\*+,C HHSM!.1 *+(~~--//8T8T8V8V**&) )&OO ) & "&% y  C A(B r*exported_programc[RS5 [RSURRSUR35 [ 5nUR URX5nUVs0sHoDUR_M nn[U5 [RSURS35 [RSUR5-5 [RS5 [XS9$s snf) aPartition the program and tag TOSA-compatible subgraphs. Run the FX capability-based partitioner to propose subgraphs, then refine tags by removing boundary-only quantize/dequantize nodes and by rejecting partitions that would lower to no-ops. Emit a detailed report of rejected nodes and their reasons. Args: exported_program (ExportedProgram): Program to analyze and partition. Returns: PartitionResult: The input program with nodes tagged for delegation and a mapping of partition tags to delegation specs. zTOSAPartitioner::partitionzPartitioning for z: z&The following nodes were rejected for : z8(Placeholders and outputs are not included in this list))tagged_exported_programpartition_tags) loggerinfor` backend_idrarr~ graph_modulerget_table_reportr)rbrrSrrMrs r(rRTOSAPartitioner.partitions"  01  4 4 ? ?@4>>BR S *+  ) )+; @DDtt333tD*+ TRR5(aURT ;ag[RR R R[RR RR4n[RR RR[RR RR4nURT;Ga(SnSnURnURnUHnURU;dMSnM UHnURU;dMSnM UR[RRRR:Xa[U5S:Xax[!U5SR[RRR"R[RRR$R4;aSnU(aU(agURT;a['U5R(n U R*(dU R,(dgURnUHzn U R[RRR.R(:wa g['U 5R(n U R,(dU R*(dMz g gURT ;a TRR5(agURT ;agg)aBFilter function applied to ops in 'ops_to_not_decompose'. Returns True if the op should not be decomposed. If this function returns True, the partitioner *must* accept the node, or the lowering fails. Args: node (torch.fx.Node): FX node to evaluate. Returns: bool: True to keep the op intact; otherwise, False. TFr?r)rarr!r5rquantized_decomposeddequantize_per_tensorr&dequantize_per_channelquantize_per_tensorquantize_per_channelrkrmr,linearrlistreluhardtanhr r3rn is_complexto)rdqqcorrect_output_quantcorrect_input_quant input_nodes output_nodesinpoutr3rh cast_dtypeops_to_not_decompose_alwaysops_to_not_decompose_if_fpops_to_not_decompose_if_integer ops_to_not_decompose_if_quant_oprbs r( filter_fn7TOSAPartitioner.ops_to_not_decompose..filter_fnds[,,..KK#== ..DDLL ..EEMMB  ..BBJJ ..CCKKA {{>>'+$&*#"22 #zz &Czz+.3+'(Czz*/4,( KK599>>#8#8#@#@@L)Q.\*1-44 ++33UYY^^5L5L5T5TUV,0(&+?{{==.d399..u7G7G#zz (D{{eiinn&7&7&=&==$%:4%@%F%F %00J4P4P4P#( ){{88>>//11{{99r*)r5rr,eyer& hardsigmoid hardswishrlinspacesilusilu_logitr6r7boolrra is_U55_subsetappendupsample_nearest2dvecupsample_bilinear2d)rbrrops_to_not_decomposerrrrs` @@@@r(r$TOSAPartitioner.ops_to_not_decompose8sH( IINN   & & IINN & & . . IINN $ $ , , IINN ! ! ) ) IINN # # + + IINN   ' ' IINN ( (, ( IINN   & & IINN ( ( IINN ! ! ) ) IINN # # + + & " IINN ( (' # IINN   & & IINN # # + + IINN   ' ' IINN ( ( + 'P EHHMMP dP P d $ '. /( ). . ~~++ ! ' ' (I(I(M(M N ' ' (J(J(N(N O$00r*)r\r`rar )r^ __module__ __qualname____firstlineno____doc__rrrrrcrstrrrurrr}r~rrRrrr5_ops OpOverloadrr6r7rr__static_attributes__r@r*r(rYrYws FJ3%3$H-@$AB3  3.0!0(+07M0 0n&* II,I) I dl I S IV" /" o" HN1 N1 tEJJ))*HXuxx}}ot>S5T,UU VN1r*rY)@rlogging itertoolsrtypingrrrrrr5.executorch.backends.arm._passes.arm_pass_utilsr =executorch.backends.arm._passes.convert_expand_copy_to_repeatr #executorch.backends.arm.common.typer !executorch.backends.arm.constantsr r Aexecutorch.backends.arm.operator_support.tosa_supported_operatorsr$executorch.backends.arm.tosa.backendr)executorch.backends.arm.tosa.compile_specr#executorch.exir.backend.partitionerrrrexecutorch.exir.backend.utilsrrexecutorch.exir.dialects._opsrr"executorch.exir.graph_modulertorch.export.exported_programrtorch.fxr!torch.fx.passes.infra.partitionerrr torch.fx.passes.operator_supportr getLoggerr^rr6rr7rr)r.r1r<rIrLrrPrWrYr@r*r(rs << P<;=E T9B9 S@   8 $O++OO@ehhmm@@Auxx}}AAQUXX]]%7%7QDQ?%((--,,??? **?t?P ((--P P P" %1G *O1kO1r*