SiK.SSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSKJ r SSK J r J r SSK Jr SSKJs Jr SSKJrJrJrJrJr \ (aSSKJrJr \"1Sk5r\"\5rSr S r!"S S 5r"S S jr#S S.S!Sjjr$S"Sjr%S#Sjr&S$S%Sjjr'S&S'Sjjr(S(Sjr)S)Sjr*S*Sjr+S+Sjr,S,Sjr-S*Sjr.S-Sjr/S*Sjr0S.Sjr1S/Sjr2S0Sjr3S1Sjr4g)2) annotationsN)chain)IO TYPE_CHECKING)AttributeProto FunctionProto GraphProto ModelProto TensorProto)CallableIterable>lengthoffsetbasepathchecksumlocation dc\rSrSrSSjrSrg)ExternalDataInfo2cSUlSUlSUlSUlSUl[ 5nSnUR HnUR[;a"[XRUR5 M9US- n[U5[:dMSURS[n[UR5[:aUS- nURU5 M U(a`[U5nU[U5- n[!U5nUS:a USUS3- n["R$"SUSUR&<S [(3S S 9 URbP[+UR5UlURS:a&[-S URSUR&<35eURbQ[+UR5UlURS:a&[-S URSUR&<35egg)Nrz...z and z morez&Ignoring unknown external data key(s) z for tensor z. Allowed keys: ) stacklevelz/External data offset must be non-negative, got z/External data length must be non-negative, got )rrrrrset external_datakey_ALLOWED_EXTERNAL_DATA_KEYSsetattrvaluelen_MAX_UNKNOWN_KEYS_IN_WARNING_MAX_KEY_DISPLAY_LENGTHaddsortedreprwarningswarnname_SORTED_ALLOWED_KEYSint ValueError) selftensor unknown_keysunknown_key_countentry truncatedshownextrakey_lists X/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/onnx/external_data_helper.py__init__ExternalDataInfo.__init__3s     !$ ))Eyy77ii5!Q&!|$'CC % *B+B CI599~(??!U*  $$Y/* <(E%E 2EE{HqyeE7%00 MM8 C$kk_-!!5 68   ;; "dkk*DK{{Q Edkk]S""(++2 ;; "dkk*DK{{Q Edkk]S""(++2 #)rrrrrN)r0r returnNone)__name__ __module__ __qualname____firstlineno__r9__static_attributes__r;r8rr2s0r;rc [R"UR55RnURbJURU:a[ SURSUSU<35eUR UR5 URblURb UROSnX4- nURU:a"[ SURSUSUSU<35eURUR5$UR5$)zValidate offset/length against actual file size and read data. Layer 3 defense-in-depth (CWE-400): prevents memory exhaustion even if the model was crafted via direct protobuf APIs that bypass Python parsing. Returns the raw bytes read from the file. zExternal data offset (z) exceeds file size (z ) for tensor rzExternal data length (z) exceeds available data (z bytes from offset ) osfstatfilenost_sizerr.seekrread) data_fileinfo tensor_name file_size read_start availables r8#_validate_external_data_file_boundsrQfs))+,44I {{ ;; "( 6;mK?<  t{{# {{$(KK$;T[[ * ;; "( 6;1*>)_.  ~~dkk** >> r;T check_existsc [RRU5n[RRU5nURU[R-5(d(XT:wa#[ R "SU<SU<SU<S35e[RRU5(a[ R "SU<SU<S35eU(ag[RRU5(aC[R"U5RS:a[ R "SU<SU<S35eU$) uValidate that an external data path is safe to open. Performs three security checks: 1. Canonical path containment — resolved path must stay within base_dir. 2. Symlink rejection — final-component symlinks are not allowed. 3. Hardlink count — files with multiple hard links are rejected. Args: base_dir: The model base directory that data_path must be contained in. data_path: The external data file path to validate. tensor_name: Tensor name for error messages. check_exists: If True (default), check hardlink count. Set to False for save-side paths where the file may not exist yet. Returns: The validated data_path (unchanged). Raises: onnx.checker.ValidationError: If any security check fails. Tensor z external data path resolves to z& which is outside the model directory .z external data path z? is a symbolic link, which is not allowed for security reasons.rzD has multiple hard links, which is not allowed for security reasons.) rEpathrealpath startswithsep onnx_checkerValidationErrorislinkexistsstatst_nlink)base_dir data_pathrMrS real_base real_paths r8_validate_external_data_pathres#6  *I  +I    BFF 2 3 3 8N**k_$DmA)a Q   ww~~i  **k_$8 FM N  y11bggi6H6Q6QTU6U**k_$8 FR S   r;c[U5n[R"XRUR5n[ R n[[ S5(aU[ R-n[ R"X45n[ R"US5n[XbUR5Ul SSS5 g!,(df  g=f)zLoads data from an external file for tensor. Ideally TensorProto should not hold any raw data but if it does it will be ignored. Arguments: tensor: a TensorProto object. base_dir: directory that contains the external data. O_NOFOLLOWrbN) r c_checker_resolve_external_data_locationrr+rEO_RDONLYhasattrrgopenfdopenrQraw_data)r0rarLexternal_data_file_path open_flagsfdrKs r8load_external_data_for_tensorrss F #D'GG-- Jr<  bmm# ( 5B 2t  = V[[    s C Cc[U5HDn[U5(dM[X!5 [RUlUR SS2 MF g)zLoads external tensors into model Arguments: model: ModelProto to load external data to base_dir: directory that contains external data N)_get_all_tensorsuses_external_datarsr DEFAULT data_locationr)modelrar0s r8load_external_data_for_modelrzsB#5) f % % )& ;#.#6#6F $$Q' *r;cURS5(d[SUR-S-5eURSS2 [R UlUUb [U5OSUb [U5OSUUS.R5H:upgUcM URR5nXhl [U5Ul M< g)NrorUzH does not have raw_data field. Cannot set external data for this tensor.)rrrrr) HasFieldr.r+rr EXTERNALrxr-itemsr&rstrr") r0rrrrrkvr3s r8set_external_datars ??: & & kk X Y  Q&//F!'!3#f+!'!3#f+   eg  =((,,.EIa&EKr;c"[U5nU(a [U5nU(a[[R"55S-nU(ad[ R RU5(a [S5e[ R RU5(a[SUS35eUnUHLnURS5(dM[R"UR5U:dMA[Xv5 MN gUHnURS5(dM[R"UR5U:dMAUR n[#U5(d[[R"55n[Xx5 M g)aNCall to set all tensors with raw data as external data. This call should precede 'save_model'. 'save_model' saves all the tensors data as external data after calling this function. Arguments: model (ModelProto): Model to be converted. all_tensors_to_one_file (bool): If true, save all tensors to one external file specified by location. If false, save each tensor to a file named with the tensor name. location: specify the external file relative to the model that all tensors to save to. Path is relative to the model path. If not specified, will use the model name. size_threshold: Threshold for size of data. Only when tensor's data is >= the size_threshold it will be converted to external data. To convert every tensor with raw data to external data set size_threshold=0. convert_attribute (bool): If true, convert all tensors to external data If false, convert only non-attribute tensors to external data Raise: ValueError: If location is not a relative path. FileExistsError: If a file already exists in location. z.datazDlocation must be a relative path that is relative to the model path.zExternal data file exists in rVroN)_get_initializer_tensorsruruuiduuid1rErWisabsr.r^FileExistsErrorr|sys getsizeofrorr+_is_valid_filename) ryall_tensors_to_one_filersize_thresholdconvert_attributetensors file_namer0tensor_locations r8convert_model_to_external_datars4'u-G"5) %/ ww}}X&& Zww~~h''%(EhZq&QRR IF ++MM&//2nD!&4 F ++MM&//2nD"(++)/::&)$**,&7O!&:r;c[U5HZn[U5(dMURS5(d [S5eURSS2 [ R UlM\ g)zCall to set all tensors which use external data as embedded data. save_model saves all the tensors data as embedded data after calling this function. Arguments: model (ModelProto): Model to be converted. roraw_data field doesn't exist.N)rurvr|r.rr rwrx)ryr0s r8 convert_model_from_external_datar9sU#5) f % %??:.. !@AA$$Q'#.#6#6F *r;c [U5n[R"UR5nUR 5(a6[ R "SUR<SUR<SU<35eSUR;a7[ R "SUR<SU<SUR<S35eURS;a3[ R "SUR<S UR<S 35e[RRXR5n[XURS S 9 URS 5(d[ R "S5e[R[R-n[![S5(aU[R"-n[R$"XES5n[R&"US5nUR)SS5 UR*b\UR-5nUR*U:a!UR/SUR*U- -5 UR)UR*5 UR-5n UR/UR05 [3XRXR-5U - 5 SSS5 g!,(df  g=f)azWrites tensor data to an external file according to information in the `external_data` field. The function checks the external is a valid name and located in folder `base_path`. Arguments: tensor (TensorProto): Tensor object to be serialized base_path: System path of a folder where tensor data is to be stored Raises: ValueError: If the external file is invalid. rUzC is external and must not be defined with an absolute path such as z , base_path=..z* is external and must be placed in folder z, '..' is not needed in rV)rVrz is external and its name z is invalid.TrRrorrgizr+brrN)rpathlibPathr is_absoluter[r\r+partsrErWjoinrer|O_CREATO_RDWRrlrgrmrnrIrtellwriteror) r0 base_pathrL location_pathrprqrrrKrNrs r8save_external_datarIs8 F #DLL/M  ""**fkk_%--1]],=>"  '   }"""**fkk_$Nm3DMM3DA G  [(**fkk_$>}}| -  !ggll9mmD!FKKd ??: & &**+JKKbii'Jr<  bmm# (e [[U5[U55$)z=Scan an ONNX model for all tensors and return as an iterator.)rr_get_attribute_tensorsonnx_model_protos r8rurus!  !12/0 r;c## UR[R:XaU"UR5ShvN UR[R:Xa$UR HnU"U5ShvN M ggNGN 7f)zICreate an iterator through processing ONNX model attributes with functor.N)typerGRAPHgGRAPHSgraphs) attributefuncgraphs r8_recursive_attribute_processorrsi~~--- $$$~~...%%EE{ " "&/ % #s!4BA>  (! s!AA5AA AAc#J# [UR5ShvN gN7f)z:Create an iterator of initializer tensors from ONNX model.N)rrrs r8rrs23C3I3IJJJs #!#c## URHfnURHSnURS5(aURv URShvN [ U[ 5ShvN MU Mh gN%N7f)zSCreate an iterator of tensors from node attributes of an ONNX model graph/function.tN)rrr|rrr!_get_attribute_tensors_from_graph)graph_or_functionrrs r8rrsq"&&I!!#&&kk! (( ( (5<   (' ) s$AA>A:A>,A<-A><A>c## [UR5ShvN URHn[U5ShvN M gN+N 7f)zDCreate an iterator of tensors from node attributes of an ONNX model.N)rr functions)rfunctions r8rrsA01A1G1GHHH$..4X>>>/I>sA A!A A  A  A cf[R"S5nURU5n[U5$)z8Utility to check whether the provided filename is valid.z^[^<>:;,?"*|/]+$)recompilematchbool)filenameexprs r8rrs) **' (C IIh E ;r;clURS5=(a UR[R:H$)z?Returns true if the tensor stores data in an external location.rx)r|rxr r})r0s r8rvrvs. ( 9  K$8$8 8r;c~[UR5H$up#URU:XdMURU M& g)zRemoves a field from a Tensor's external_data key-value store. Modifies tensor object in place. Arguments: tensor (TensorProto): Tensor object from which value will be removed field_key (string): The key of the field to be removed N) enumeraterr)r0 field_keyifields r8remove_external_data_fieldrs5f223 99 !$$Q'4r;c[U5HIn[U5(dMURS5(dM-[X!5 UR S5 MK U$)aSerializes data for all the tensors which have data location set to TensorProto.External. Note: This function also strips basepath information from all tensors' external_data fields. Arguments: model (ModelProto): Model object which is the source of tensors to serialize. filepath: System path to the directory which should be treated as base path for external data. Returns: ModelProto: The modified model object. ro)rurvr|r ClearField)ryfilepathr0s r8write_external_data_tensorsrsK#5) f % %&//**E*E v 0   j )* Lr;)rKz IO[bytes]rLrrMrr<bytes) rarrbrrMrrSrr<r)r0r rarr<r=)ryr rarr<r=)NNNN)r0r rrr int | Nonerrr str | Nonerrr<r=)TNiF) ryr rrrrrr-rrr<r=)ryr r<r=)r0r rrr<r=)rr r<Iterable[TensorProto])rrrz-Callable[[GraphProto], Iterable[TensorProto]]r<r)rr r<r)rzGraphProto | FunctionProtor<r)rrr<r)r0r r<r)r0r rrr<r=)ryr rrr<r )5 __future__rrErrrrr) itertoolsrtypingrr onnx.checkercheckerr[onnx.onnx_cpp2py_export.checkeronnx_cpp2py_exportri onnx.onnx_pbrrr r r collections.abcr r frozensetr r'r,r$r%rrQrersrzrrrrrurrrrrrrvrrrCr;r8rs#  $#332 (<9:!11h      P ,,,,  ,  ,^ 2 (& ! !! !  !  !  ! !@%)# 7; 7;!7;7; 7;  7;  7;t 7 ?TD##%R##K 1  ? (r;