9i+SSKrSSKrSSKrSSKJrJr SSKJr SSKJ r SSK J r SSK J r SSKJrJr SSKJrJrJr SS KJr \R."\5r\R4"S S 9"S S \55r"SS5r\R4"SS55rS\SSSS4SjrS\SS4Sjr\ \!\"\4r#"SS5r$g)N)ABCabstractmethod) defaultdict) Generator)contextmanager)chain)AnyOptional)AppendingByteSerializer BytesReader BytesWriter) OrderedSetT)frozenc\rSrSr%Sr\\S'\R"SS9r \ \S'\ S\ SSS S 4S j5r \ S \S \S S4Sj5r\ S\S \ 4Sj5r\SSj5rS \4Sjr\ S \4Sj5rSrg ) CacheArtifactzG Data for each cache artifact that will be serialized and deserialized keyF)reprcontentwriterclsreturnNcpURUR5 URUR5 gN) write_strr write_bytesr)rrs U/var/www/html/land-doc-ocr/venv/lib/python3.13/site-packages/torch/compiler/_cache.py serializeCacheArtifact.serializes&!3;;' artifact_typereadercnUR5nUR5n[RXU5$r)read_str read_bytesCacheArtifactFactorycreate)r!r"rrs r deserializeCacheArtifact.deserialize$s/oo##%#**=wGGr cV[U[5(dS[U535eU$)NzExpected bytes, got ) isinstancebytestype)rs rencodeCacheArtifact.encode*s+'5))Q-A$w-+QQ)r cgrselfs rpopulate_cacheCacheArtifact.populate_cache/s r cg)NFr1r2s rprecompile_compatible#CacheArtifact.precompile_compatible3sr c[S5e)z Returns the type of the artifact. Must be unique across all CacheArtifact classes. CacheArtifactFactory.register will add property method to CacheInfo based on this (def {type}_artifacts) that returns all artifacts for specific cache. z9CacheArtifact is an abstract class, please use a subclass) RuntimeErrorr1r rr-CacheArtifact.type6sVWWr r1rN)__name__ __module__ __qualname____firstlineno____doc__str__annotations__ dataclassesfieldrr, staticmethodr rr r(r r.rr4boolr7r-__static_attributes__r1r rrrs H &&E2GU2(+(O(((H3H HHH   tX#XXr rc \rSrSr%Sr0r\\\\ 4\ S'\ S\\ S\\ 4Sj5r \ S\S\\ 4Sj5r \ S\S \S \S\ 4S j5r\ S\S \S \S\ 4S j5rS rg)r&Az@ Factory for creating CacheArtifact objects based on their type _artifact_types artifact_clsrc^UR5mUR5UR;d STS35eXRT'[[TS3[ U4Sj55 U$)NArtifact of type=z2 already registered in mega-cache artifact factory _artifactsc">URT$r artifacts)r3artifact_type_keys r/CacheArtifactFactory.register..Rs$..1B"Cr )r-rKsetattr CacheInfoproperty)rrLrSs @rregisterCacheArtifactFactory.registerHs}(--/  "#*=*==  122d e =2>-.  ! , C D r rScTXR;d SUS35eURU$)NrNz. not registered in mega-cache artifact factory)rK)rrSs r_get_artifact_type'CacheArtifactFactory._get_artifact_typeVs> $7$77  122` a 7""#455r rrc4URU5nU"X#5$r)r\rrSrrrLs rr'CacheArtifactFactory.create]s--.?@ C))r cRURU5nU"X$RU55$r)r\r.r_s r encode_create"CacheArtifactFactory.encode_createbs+--.?@ C!4!4W!=>>r r1N)r=r>r?r@rArKdictrBr-rrC classmethodrYr\r,r'r rbrHr1r rr&r&As79OT#tM2238 D$7 Drs D 1r )default_factoryrRrcgrr1r2s rinductor_artifactsCacheInfo.inductor_artifactsv r cgrr1r2s rautotune_artifactsCacheInfo.autotune_artifactszror cgrr1r2s raot_autograd_artifacts CacheInfo.aot_autograd_artifacts~ror cgrr1r2s r pgo_artifactsCacheInfo.pgo_artifactsror cgrr1r2s r!precompile_aot_autograd_artifacts+CacheInfo.precompile_aot_autograd_artifactsror cgrr1r2s rprecompile_dynamo_artifacts%CacheInfo.precompile_dynamo_artifactsror artifactNcpURUR5RUR5 gr)rRr-appendr)r3rs radd CacheInfo.adds# x}}'..x||>!!r r1r<)r=r>r?r@rArDrErRrrBrirCrXrmrqrtrwrzr}rrrrGrrHr1r rrWrWjs .9->->1.I{3S >*  DI   DI   S    tCy   49   T#Y  =M=d="t"r rWrrztuple[str, list[CacheArtifact]]rcURUS5 UR[US55 USHn[R X5 M g)Nr)r write_uint64lenrr)rrrs r_serialize_single_cachersH SV CF $F1r r"c/nUR5nUR5n[U5H'nUR[R X 55 M) X!4$r)r$ read_uint64rangerrr()r"rRrS num_artifacts_s r_deserialize_single_cachersXI)&&(M = !223DMN"  ''r c \rSrSr%Sr\"\5r\\ S'\ "5r \ \ \ S'\ "\S9r\ \\\\ 4\ S'\"5r\\ S'\SS j5r\\S\S 4S j55r\S \S\S\SS 4Sj5r\S\4Sj5r\S\\\\44Sj5r\ S\S\\4Sj5r!\ S\S\4Sj5r"\SSj5r#Sr$g )CacheArtifactManagera! Lightweight manager class for collecting and processing cache artifacts for hot loading Intended Lifecycle: - Execute code via torch.compile, this will call CacheArtifactManager.record_artifact on each cache artifact - Call CacheArtifactManager.serialize to convert all the cache artifacts to portable format - Call CacheArtifactManager.deserialize to hot load the cache artifacts on a potentially different process NOTE: There's no FB/FC guarantees, results of cache artifacts will not be used unless code version matches. _new_cache_artifacts_seen_artifacts serialize_fn _serializer _cache_inforNcURR5 URR5 URR5 URR5 gr)rrrrrrs rrCacheArtifactManager.clearsF   &&( !!#  r )NNNc## URnURnURnURn[ [ 5Ul[ 5Ul[[S9UlURR5UlSv XlX lX0lX@lg!XlX lX0lX@lf=f7f)Nr) rrrrrrirr r __class__)roriginal_new_cache_artifactsoriginal_seen_artifactsoriginal_serializeroriginal_cache_infos rwith_fresh_cache%CacheArtifactManager.with_fresh_caches(+'?'?$"%"5"5!oo!oo#.t#4 (l1?VW//335 2 'C $"9 1O1O(D $"9 1O1OsBCB% C%B??Cr!rrc[RXU5nX@R;ag[R S[ U55 UR URU5 URRU5 g)zO Called from each caching operation to record the artifact in this "mega" list Nz Recording %s) r&rbrlogdebugrBrrr)rr!rrrs rrecord_artifact$CacheArtifactManager.record_artifactsd(55m'R ** *  .#h-0   /66x@ )r c2[UR5S:g$)z7 Have we seen new artifacts since last serialize call? r)rrrs rneed_serialize#CacheArtifactManager.need_serializes 3++,11r cP[URR56H4n[R SU5 UR R U5 M6 UR R5(ag[R"UR 5nURRURR55 URR5nURR5 X24$![a [R!SSS9 gf=f)z/ Converts the "mega" list into portable format z saving: %sNz Failed to pickle cache artifactsTexc_info)rrvaluesrrrrrcopydeepcopyrextenditemsto_bytesr Exceptionwarning)rrinfoartifact_bytess rrCacheArtifactManager.serializes s77>>@AH IIlH - OO   )B ?? " " K==1D OO " "3#;#;#A#A#C D __557N  $ $ * * ,!' ' K KK:TK J Ks:B DD%$D%serialized_artifactsc[R5 [[R"U[ S95nU$![ a [RSSS9 gf=f)z7 Converts the portable format back into CacheArtifacts )deserialize_fnz#Failed to un-pickle cache artifactsTrN) r"_ensure_cache_artifacts_registeredrdr to_listrrrr)rrRs rr( CacheArtifactManager.deserializes^  C C E'//(#<I   KK=K M s6:AArRc[5n[UR56H:n[R SU5 UR U5 UR 5 M< U$)Nz writing: %s)rWrrrrrr4)rRrrs rpopulate_caches$CacheArtifactManager.populate_caches/sN{y//12H IImX . HHX   # # %3  r c4SSKJn SSKJn SSKJn SSKJn g)zWhen deserializing caches in fresh process, we need to ensure that all cache artifacts are registered in the cache registry. This is done by simply importing all the cache artifacts already wrapped with register call. r)PGOCacheArtifact)AOTAutogradCacheArtifact)InductorCacheArtifact)AutotuneCacheArtifactN)torch._dynamo.pgor-torch._functorch._aot_autograd.autograd_cachertorch._inductor.codecacher&torch._inductor.runtime.autotune_cacher)rrrrrs rr7CacheArtifactManager._ensure_cache_artifacts_registered9s 7  D r r1r<)%r=r>r?r@rArrirCacheArtifactsResultrCrrrr rrtuplerBrWrrerrrrr rrGrr r,rrFr(rrrHr1r rrrs"2=T1B.B2<OZ .= -DE(sD4G/G)HI'[K(  2+;!<22$*** *  **"2t22 (5 )9#:;2%H=Q4R$#7I    r r)%rrDloggingabcrr collectionsrcollections.abcr contextlibr itertoolsrtypingr r &torch.utils._appending_byte_serializerr r r torch.utils._ordered_setr getLoggerr=r dataclassrr&rWrrrdrBrirrr1r rrs ##%%  0! d#'XC'X$'XT&?&?R *"*"*"Z2 2?2 2 (  (& (Cm!445V V r