iEpSSKrSSKrSSKJrJrJr SSKrSSKrSSK J r SSK J r SSK Jr SSKJr SSKJr SSKJr SS KJrJr SS KJr SS KJrJr SS KJr SS KJ r SSK!J"r" "SS5r#SS\$S\\$S\\$S\\\$S\%S\%S\%S\\4Sjjr&\"SS\55r'"SS5r(g)N)finalListOptional)RemoveGetItemPass) DataFormat)EdgeProgramToIRConverter)ConversionConfig)NeutronConverterManager)NeutronTargetSpec)#extract_artifacts_from_neutron_nodeNeutronNodeArtifacts)NeutronPassManager)BackendDetailsPreprocessResult) CompileSpec)EXIREdgeDialectVerifier)ExportedProgramc \rSrSr%\\S'SrS\S\4SjrSS\S\ \S \ \ \S \ S \ S \ 4 S jjr Sr Srg)NeutronCompileSpecBuilder'configcf/Ul/UlSUl/UlSUlSUlSUlg)NTF) compile_speccompiler_flags output_formatoperators_not_to_delegate!use_neutron_for_format_conversionfetch_constants_to_sramdump_kernel_selection_codeselfs b/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/executorch/backends/nxp/nxp_backend.py__init__"NeutronCompileSpecBuilder.__init__*s:/1 !46&15.',$*/'operatorreturnc&URSS5$)z Replace '::' with '_' z::_)replace)r!r&s r"_replace_colons)NeutronCompileSpecBuilder._replace_colons3sc**r%N extra_flagsrrrrc@[U5UlURbSUR35eSUl/UlUbURR U5 Ub&UVs/sHopR U5PM snUlX@lXPlX`l U$s snf)a= Generate compile spec for Neutron NPU Args: config: Neutron accelerator configuration, e.g. "imxrt700" extra_flags: Extra flags for the Neutron compiler operators_not_to_delegate: List of operators that should not be delegated use_neutron_for_format_conversion: If True, the EdgeProgramToIRConverter will insert `Transpose` ops to ensure that the IO matches the executorch partition, which will be delegated to Neutron. fetch_constants_to_sram: If True, the Neutron Converter will insert microinstructions to prefetch weights from FLASH to SRAM. This should be used when the whole model does not fit into SRAM. dump_kernel_selection_code: Whether Neutron converter dumps kernel selection code. zOutput format already set to ftflite) r rrrappendr+rrrr)r!rr-rrrrops r"neutron_compile_spec.NeutronCompileSpecBuilder.neutron_compile_spec9s0(/     & A +D,>,>+? @ A &%   "    & &{ 3 $ 03L.3LR$$R(3L.D *2S.'>$*D' .s%Bc URS:XGa/U=R[SSR55[SSR UR 5R55[SUR R5R55[SSR UR5R55[SURR55[S URR55[S URR55/- slUR$) z: Generate a list of compile spec objects from the builder r/r compile_flags targetr,rrr) rrrencodejoinrrget_namerrrrr s r"buildNeutronCompileSpecBuilder.buildgs    )   OX__->?OSXXd6I6I-J-Q-Q-STHdkk&:&:&<&C&C&EF/HHT;;<CCE7==>FFH-334<<>0667??A!"  ,   r%)rrrrrrrr)NNTFF)__name__ __module__ __qualname____firstlineno__r __annotations__r#strr+rrboolr2r<__static_attributes__r%r"rr's 0+++&*9=26(-+0,,c],$,DI#6 , ,0 , "& ,%),\!r%rr system_configr-rrrrr'c V[5RUUUUUUS9R5$)N)r-rrrr)rr2r<)rrGr-rrrrs r"generate_neutron_compile_specrIs: "#   #&?.O$;'A    r%c:\rSrSr\S\S\\S\4Sj5r Sr g)NeutronBackend edge_programrr'cB[R"S5 [R"SUR35 Sn/n[ 5nSnSnSnSnUGHn U R S:XaU R R5nU R S:XaU R R5nU R S:Xa)URU R R55 U R S:XaU R R5S :HnU R S :XaU R R5S :HnU R S :XdMU R R5S :HnGM U(d [S 5eURRH8n U RS :XdM[R"SU R35 M: US:XGa [S[RR R"R$[RR R&R$/S9/Ul[+U[,/5R/5nSn URRH2n SU R0R35;dM#U R0Sn O U ce[5UbSU0O05n [75R9U[;U5U S9up[=U5R?XX5n[R@RC[RD5(aSSK#n[R"SU SURI535 [KU S3S5nURM[ U55 SSS5 [KU S3S5nURM[ U55 SSS5 [O5RQUU5nO[SU35e[SUS9$!,(df  Nr=f!,(df  NQ=f)NzNeutronBackend::preprocessz$NeutronBackend preprocessing graph: Frr7r5rTruerrzoutput format is required call_functionzOperator to be processed: r/T) class_onlycore_aten_ops_exception_listdelegation_tag)neutron_target_specconversion_configrz%Serializing converted graph with tag z to z_pure.et.tflitewbz_neutron.et.tflitezUnknown format )processed_bytes)*logginginfodebuggraphbyteskeyvaluedecoder0 RuntimeErrornodesr1r7rtorchopsaten max_pool2ddefaultprelu _verifiersrr transformmetakeysr rconvert_programr r convertroot isEnabledForDEBUGosgetcwdopenwritePayloadComposerget_binary_payloadr)rMrrr5binaryr7rrrspecnoderTnrV tflite_model io_formats neutron_modelrrfs r" preprocessNeutronBackend.preprocesss  12 =l>P>P=QRS  ,0)"'%)" Dxx?* $ 1 1 3 xx8#**,xx?*$$TZZ%6%6%89xx>>48JJ4E4E4G64Q1xx44*.***;*;*=*G'xx77-1ZZ->->-@F-J*!:; ; &&,,Dww/) :4;;-HI- H $(# 1199 ,,442'L #.01ik  "N!''--#qvv{{}4%&VV,<%=N."- --!14@56WX!  (@'A'Q'Q$5f$="3(R( $L 44NOWWnM ||((77 ;N;K4PRPYPYP[}]^,O?F!GGE-01G%&99*mTF@A A77DCFFs8O?*P? P  PrFN) r>r?r@rA staticmethodrrrrrrErFr%r"rKrKs:`8%`8;'`8 `8`8r%rKc\rSrSrSrS\R S\4SjrS\R S\4Sjr S\ \\ \ 4S\R 4Sjr S \R S \S\4S jrS\ \\ \ 4S\4S jrS rg)rviarrayr'cUR[R"S5:XdeURUR-nUS:XagURU- S3$)zCreate a padding format string for the given array, which will add 0s at the end for correct alignment. E.g. the string '10x' represents adding 10 bytes of '0' padding. uint8rrOx)dtypenpsize ALIGNMENT)r!roverflows r" _padding_format_string_for_array0PayloadComposer._padding_format_string_for_arraysT{{bhhw////::. q=..8+,A..r%cUR[R"S5:XdeURSURU53$)aCreate a format string which will represent the provided array. It also handles the necessary alignment. E.g. for array [1,2,3] we get '3s13x', because '3s' means string of 3 bytes, and `13x` means adding 13 bytes of '0' padding at the end (for 16B alignment). rs)rrrr)r!rs r"_format_string_for_array(PayloadComposer._format_string_for_arrays@ {{bhhw////**QtDDUKLMMr%r}cUSnUSn[UR5S:dS5e[UR5S:dS5e[UR5/nUR[UR55 UR[U55 URH;nURX6R 5[ R:XaSOS5 M= URH;nURXGR 5[ R:XaSOS5 M= URUR5 URUR5 URUR5 [R"U[RS 9$![a [SUR 5S 35ef=f![a [S UR 5S 35ef=f) ar Create bytes header for returned payload. It contains information about input and output tensor formats. Tensors are ordered based on graph signature of ExportedProgram. Header schema: +----------------------------+-----------------------------+------------------------+ | Neutron inputs length (1B) | Neutron outputs length (1B) | Input args length (1B) | +----------------------------+-----------+-----------------+------------------------+ | 1st input tensor format (1B) | [nth* input tensor format (1B)] | +----------------------------------------+------------------------------------------+ | 1st output tensor format (1B) | [nth* output tensor format (1B)] | +----------------------------------------+------------------------------------------+ | 1st input map (1B) | [nth* input map (1B)] | +----------------------------------------+------------------------------------------+ | 1st output map (1B) | [nth* output map (1B)] | +----------------------------------------+------------------------------------------+ | Payload version (1B) | +-----------------------------------------------------------------------------------+ :param io_formats: IO tensors formats. :return: Bytes representation of payload header. inputsoutputsz3Models with more than 255 inputs are not supported.z4Models with more than 255 outputs are not supported.rzInput tensor `z#` not found in the converted model.zOutput tensor `)r)len input_indicesoutput_indicesr0 input_namesr`r CHANNELS_LASTKeyErrorAssertionError output_namesextendpayload_versionrrr)r!r}neutron_artifactsrr header_data input_name output_names r"_create_payload_header&PayloadComposer._create_payload_headers2H%Y' !// 03 6 A @ A 6 !00 1C 7 B A B 7,::;< 30??@A3v;'+77J "" 1 1 34 8P8PPAVW8-99K ""1134 8P8PP: ,::;,;;<,<<=xx 28844- $$Z%6%6%8$99\]  $%k&8&8&:%;;^_ s/7F):7G)(G(G<headerrc[R"URU5URUR5-URUR5-URUR 5-UR 5URR 5URR 5UR R 55$)z Packs provided data into serialized binary data of the following C struct: struct NeutronBinary { uint8[] header; uint8[] microcode; uint8[] weights; uint8[] kernels; } The individual components must be aligned to 16 bytes. )structpackr microcodeweightskernelstobytes)r!rrs r"_pack_with_alignment$PayloadComposer._pack_with_alignment`s{{  ) )& 1++,=,G,GH I++,=,E,EF G++,=,E,EF G NN   ' ' / / 1  % % - - /  % % - - /  r%c\[U5nURX5nURXC5$)a Get binary payload for provided input/output tensor formats and neutron_model. Returned data have following structure: +----------------------------------------------------------------------------------------------------------------+ | 16 bytes aligned blocks | +================================================================================================================+ | Header | +----------------------------------------------------------------------------------------------------------------+ | Neutron microcode | +----------------------------------------------------------------------------------------------------------------+ | Neutron weights | +----------------------------------------------------------------------------------------------------------------+ | Neutron kernels | +----------------------------------------------------------------------------------------------------------------+ Tensor format definition: '0x1' == CHANNELS_LAST, '0x0' == FORMATLESS (no format). :param io_formats: Dictionary with keys 'inputs' and 'outputs' that contains dictionaries mapping tensor name to DataFormat. :param neutron_model: Neutron model with single NeutronGraph node. :return: 16 bytes aligned binary payload. )r rr)r!r}r~rrs r"rw"PayloadComposer.get_binary_payloadys16@ N,,ZK((CCr%rFN)r>r?r@rArrndarrayrCrrdictlistrrr r]rrwrErFr%r"rvrvsI /bjj /S /NbjjNSNB5sD$445B5 B5H jj 5I  2DsD$445D Dr%rv)NNNTFF))rYrtypingrrrnumpyrrc3executorch.backends.nxp._passes.remove_getitem_passr+executorch.backends.nxp.backend.data_formatr6executorch.backends.nxp.backend.edge_program_converterr4executorch.backends.nxp.backend.ir.conversion_configr 9executorch.backends.nxp.backend.neutron_converter_managerr 3executorch.backends.nxp.backend.neutron_target_specr /executorch.backends.nxp.neutron_node_extractionr r ,executorch.backends.nxp.neutron_pass_managerr'executorch.exir.backend.backend_detailsrr+executorch.exir.backend.compile_spec_schemar%executorch.exir.verification.verifierrtorch.export.exported_programrrrCrDrIrKrvrFr%r"rs (( QBRRLTCI9[![!@$(!%59.2$)', C=# (S 2  (,  " !% +.c8^c8c8LUDUDr%