9i 6%SSKrSSKrSSKrSSKrSSKJr SSKJr SSKJ r SSK J r J r SSK J r SSKJr SSKJr SS KJrJrJrJrJr SS KJrJr SSKrSSKrSS KJrJrJ r SS K!J"r" S SK#J$r$ S SK%J&r&J'r' S SK(J)r)J*r*J+r+J,r, S SK-J.r.J/r/ S SK0J1r1J2r2J3r3 S SK4J5r5J6r6J7r7J8r8 S SK9J:r: \Rv"S\Rx5r=\ "SS55r>\?"\R5rA\\BS'"SS\A5rC"SS\R\CS9rD"SS\RR5rG"S S!\RR5rHS"\IS#\I4S$jrJS%\IS#\I4S&jrKS'\IS(\\LS#\4S)jrMS*\DS'\IS+\IS,\NS-\I4 S.jrOS3S/\RS0\NS#\Q4S1jjrRS2rS\D"5rTg)4N)deque) ExitStack)deepcopy) dataclassfield)datetime)chain)Path)AnyIteratorNoReturnOptionalUnion)quoteunquote)_DEFAULT_CALLBACK NoOpCallback TqdmCallback) isfilelike) constants)CommitOperationCopyCommitOperationDelete)EntryNotFoundErrorHfHubHTTPErrorRepositoryNotFoundErrorRevisionNotFoundError) hf_hub_urlhttp_get)HfApiLastCommitInfoRepoFile)HFValidationErrorhf_raise_for_status http_backoffhttp_stream_backoff)md5zy (^refs\/convert\/\w+) # `refs/convert/parquet` revisions | (^refs\/pr\/\d+) # PR revisions cn\rSrSr%Sr\\S'\\S'\\S'\\S'\"SSS 9r\ \\S 'S \4S jr S r g)HfFileSystemResolvedPath(zUData structure containing information about a resolved Hugging Face file system path. repo_typerepo_idrevision path_in_repoNF)defaultrepr _raw_revisionreturnc[RRURS5UR-nUR (a-USUR SUR 3RS5$UR[R:wa6US[UR5SUR 3RS5$USUR 3RS5$)N@/) rREPO_TYPES_URL_PREFIXESgetr+r,r1r.rstripr-DEFAULT_REVISION safe_revision)self repo_paths ^/var/www/html/land-doc-ocr/venv/lib/python3.13/site-packages/huggingface_hub/hf_file_system.py unresolve"HfFileSystemResolvedPath.unresolve4s5599$.."MPTP\P\\   [$"4"4!5Qt7H7H6IJQQRUV V ]]i88 8[- ">!?qARAR@ST[[\_` `[$"3"3!45<r)r)(s?_N LM$)E#BM8C=BB3BrAr) _cached_basec2^\rSrSrSrU4SjrSrSrU=r$)_CachedBa Metaclass for caching HfFileSystem instances according to the args. This creates an additional reference to the filesystem, which prevents the filesystem from being garbage collected when all *user* references go away. A call to the :meth:`AbstractFileSystem.clear_instance_cache` must *also* be made for a filesystem instance to be garbage collected. This is a slightly modified version of `fsspec.spec._Cached` to improve it. In particular in `_tokenize` the pid isn't taken into account for the `fs_token` used to identify cached instances. The `fs_token` logic is also robust to defaults values and the order of the args. Finally new instances reuse the states from sister instances in the main thread. c4>[TU]"U0UD6 0UlgN)super__init___cache)clsargskwargs __class__s r>rR_Cached.__init__Rs $)&) rAcURSS5nUR"U[R"5/UQ70UD6nUR"U[R"5R /UQ70UD6nU(d5UR (a$X@R;aX@lURU$[R"U/UQ70UD6nU(dbUR (aQXPR;aBURUR5nUR5Hup[XhU 5 M XFlXlX&lUR (aU(dX@lX`RU'U$)Nskip_instance_cacheF)pop _tokenize threading get_ident main_threadidentcachablerS_latesttype__call___get_instance_stateitemssetattr _fs_token_ storage_argsstorage_options) rTrUrVskipfs_tokenfs_token_main_threadobjinstance_stateattr state_values r>rd_Cached.__call__Zszz/7==i&9&9&;MdMfM"}}S)2G2G2I2O2OaRVaZ`a ZZ)?"K::h' '--5d5f5CCLL-AZZ-O!$,@!A!U!U!W)7)=)=)?%DC{3*@%N# "( ||D& '* 8$JrArB) rCrDrErFrGrRrdrJ __classcell__rWs@r>rMrMBs rArMc^\rSrSrSrSrSrSSSSS.S\\S\ \ \S4S \\ S \\ 4U4S jjjr \ S \ S \4Sj5rS\S\S\\S \\ \\44SjrS4S\S\\S \4SjjrS4S\\S S4SjjrS5S\S\S \\ S\\S \ S4 SjjrS4S\S\\S S4SjjrS6S\S\ S\\ S\\S S4 SjjrS7S\S\ S\ S\\S \\ \\\\444 SjjrS8S\S\ S\ S\\S \\ S\\ 4 S jjrS\S \\\\\\\44U4S!jjrS4S\S\\ S \\4U4S"jjjrS9S\S\\ S#\ S\ S\ S\\S \ \\\\\\\4444S$jjr S4S%\S&\S\\S S4S'jjr!S\S \"4S(jr#S:S\S\ S\\S \\\44S)jjr$S*r%S+r&S,r'S\S \4S-jr(\)S4S;U4S.jjjr*\+S/5r,S0r-S1r.S2r/S3r0U=r1$)< HfFileSystemta Access a remote Hugging Face Hub repository as if were a local file system. > [!WARNING] > [`HfFileSystem`] provides fsspec compatibility, which is useful for libraries that require it (e.g., reading > Hugging Face datasets directly with `pandas`). However, it introduces additional overhead due to this compatibility > layer. For better performance and reliability, it's recommended to use `HfApi` methods when possible. Args: endpoint (`str`, *optional*): Endpoint of the Hub. Defaults to . token (`bool` or `str`, *optional*): A valid user access token (string). Defaults to the locally saved token, which is the recommended method for authentication (see https://huggingface.co/docs/huggingface_hub/quick-start#authentication). To disable authentication, pass `False`. block_size (`int`, *optional*): Block size for reading and writing files. expand_info (`bool`, *optional*): Whether to expand the information of the files. **storage_options (`dict`, *optional*): Additional options for the filesystem. See [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.__init__). Usage: ```python >>> from huggingface_hub import hffs >>> # List files >>> hffs.glob("my-username/my-model/*.bin") ['my-username/my-model/pytorch_model.bin'] >>> hffs.ls("datasets/my-username/my-dataset", detail=False) ['datasets/my-username/my-dataset/.gitattributes', 'datasets/my-username/my-dataset/README.md', 'datasets/my-username/my-dataset/data.json'] >>> # Read/write files >>> with hffs.open("my-username/my-model/pytorch_model.bin") as f: ... data = f.read() >>> with hffs.open("my-username/my-model/pytorch_model.bin", "wb") as f: ... f.write(data) ``` Specify a token for authentication: ```python >>> from huggingface_hub import HfFileSystem >>> hffs = HfFileSystem(token=token) ``` r4hfN)endpointtoken block_size expand_inforyrzr{r|c>[TU]"U0UD6 U=(d [RUlX l[ XS9UlX0lX@l 0Ul 0Ul g)N)ryrz) rQrRrENDPOINTryrzr _apir{r|_repo_and_revision_exists_cachedircache)r<ryrzr{r|rUrjrWs r>rRHfFileSystem.__init__s[ $2/2 6I$6$6  89 $&  ,:< rAthreading_identr2c0URS5=(d [RUS'URS5US'[U5Vs0sHoDX4_M nnXX#4n[ [ U5R 55nUR5$s snf)zDeterministic token for cachingryrz)r8rr~sortedr'rHencode hexdigest)rTrrUrVkey tokenize_argshs r>r\HfFileSystem._tokenizes$ZZ 3Iy7I7Iz **W-w.4Vn=nsv{"n=t< M"))+ ,{{} >s Br+r,r-cXU4UR;aLURRX#U[RS9 SURXU4'SURXS4'URXU4$![ [ 4a0nSU4URXU4'SU4URXS4'SnANLSnAf[a.nSU4URXU4'SURXS4'SnANSnAff=f)N)r-r+timeout)TNF)rr repo_inforHF_HUB_ETAG_TIMEOUTrr#r)r<r+r,r-es r>_repo_and_revision_exist%HfFileSystem._repo_and_revision_exists  )1U1U U ^ ##)YMjMj$Xb44i(5STS]44i$5OP33Y4RSS,->? \W\^_W_44i(5STSXZ[S[44i$5OP( ^W\^_W_44i(5STS]44i$5OP ^s#)A00C&&B++ C&8$C!!C&pathcHS[[S[[S[[4SjnURU5nU(d [S5eUR S5SS-[ R R5;a9SU;a [S5eUR SS5upA[ RUnO[ RnURS5S:GaS U;aUR S S5upVSU;ay[RU5nUbLUS UR54;a6[RS U5RS5nUR5nOUR SS5uphOS nU"[!U5U5nUR#XEU5upU (d [%X5 GOIS nSR'UR S5S S 5n SR'UR S5S S 5n UR S5Sn SR'UR S5SS 5nU nU nUR#XEU5upU (dQ[)U [*[,45(a+U nUnUR#XEU5upU (d [%X5 Oe[%X5 OYUnS nS U;a'UR S S5upVU"[!U5U5nOS nUR#XEU5upU (d [S5eUbUO[ R.n[1XEX(US 9$)a Resolve a Hugging Face file system path into its components. Args: path (`str`): Path to resolve. revision (`str`, *optional*): The revision of the repo to resolve. Defaults to the revision specified in the path. Returns: [`HfFileSystemResolvedPath`]: Resolved path information containing `repo_type`, `repo_id`, `revision` and `path_in_repo`. Raises: `ValueError`: If path contains conflicting revision information. `NotImplementedError`: If trying to list repositories. revision_in_pathr-r2cHUbUbX:wa[SUSUS35eU$UnU$)NzRevision specified in path ("z ") and in `revision` argument ("z") are not the same.) ValueError)rr-s r>%_align_revision_in_path_with_revisionHHfFileSystem.resolve_path.._align_revision_in_path_with_revisionsS##/4D4P$78H7IIijrist-- O,OrAz0Access to repositories lists is not implemented.r6rrr5Nr4)r1)rrH_strip_protocolNotImplementedErrorsplitrr7valuesREPO_TYPES_MAPPINGREPO_TYPE_MODELcountSPECIAL_REFS_REVISION_REGEXsearchgroupsublstriprr_raise_file_not_foundjoin isinstancerr#r:r))r<rr-rr+r,rmatchr.repo_and_revision_existerrrepo_id_with_namespacepath_in_repo_with_namespacerepo_id_without_namespacepath_in_repo_without_namespace_s r> resolve_pathHfFileSystem.resolve_paths( &sm 7?}  c] ##D)%&XY Y ZZ_Q # %)J)J)Q)Q)S S$)*\]]"jja0OI!44Y?I!11I ::c?Q d{,0JJsA,>)**7>>?OPE(X$ 9N-N'B'F'FrK['\'c'cdg'h +0;;=(9I9O9OPSUV9W6(,#%L@IYAZ\de/3/L/LYai/j,'.)$4#' ),$**S/"12E)F&.1hhtzz#qr7J.K+,0JJsOA,>)14$**S/!":M1N.0: /3/L/LYai/j,'.!#(?AR'STT";'E 595R5RS\go5p2/61$<-d8GLd{,0JJsA,>)@IYAZ\de#' )-)F)Fy[c)d & #*)*\]]'389S9S' HbrssrAc<U(d5URR5 URR5 gURU5nUR 5nU(a6URR US5 UR U5nU(aM6UR(dqURR URURS4S5 URR URURUR4S5 gg)a3 Clear the cache for a given path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.invalidate_cache). Args: path (`str`, *optional*): Path to clear from cache. If not provided, clear the entire cache. N) rclearrrr?r[_parentr.r+r,r-)r<r resolved_paths r>invalidate_cacheHfFileSystem.invalidate_cache>s MM   !  0 0 6 6 8 --d3M **,D !!$-||D)$ !--4488-:Q:QS`ShShjn9oquv4488",,m.C.C]E[E[\^b.rAmode)HfFileSystemFileHfFileSystemStreamFilec UbUO URnUbX5S'SU;a [S5eUS:Xa[X4X$S.UD6$[X4X$S.UD6$)Nr{az/Appending to remote files is not yet supported.r)rr-)r{rrr)r<rrr{r-rVs r>_openHfFileSystem._openZsh$.#9Zt  !#-< $;%&WX X ?)$]4]V\] ]#DWTWPVW WrAc :URXS9nURRURURUR UR URURS5URS5S9 URUR5S9 g)Nr-commit_messagecommit_description)r.r,rzr+r-rrr) rr delete_filer.r,rzr+r-r8rr?)r<rr-rVrs r>_rmHfFileSystem._rmls))$)B  &33!))**#--"++!::&67%zz*>?   =#:#:#<=rA recursivemaxdepthc RURXS9nURXX4S9nUVs/sH5oRU5(aMURU5RPM7 nnUV s/sH n [ U S9PM n n SWS3n X(aSOS- n XbS US3OS- n UR R URURURU URURS U 5URS 5S 9 URUR5S 9 gs snfs sn f)ad Delete files from a repository. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.rm). > [!WARNING] > Note: When possible, use `HfApi.delete_file()` for better performance. Args: path (`str`): Path to delete. recursive (`bool`, *optional*): If True, delete directory and all its contents. Defaults to False. maxdepth (`int`, *optional*): Maximum number of subdirectories to visit when deleting recursively. revision (`str`, *optional*): The git revision to delete from. r)rrr-)r.zDelete  z recursively r4Nz up to depth rr)r,r+rz operationsr-rrr)r expand_pathisdirr.rr create_commitr,r+rzr-r8rr?) r<rrrr-rVrpaths paths_in_repor.rrs r>rmHfFileSystem.rmys.6))$)B   X aJOh%$WaWabfWg=**40==% h[hi[h<+F[h i"4&*I.2=8LL !4RTT !))#--**!"++!::&6G%zz*>?   =#:#:#<=iisDD&D$detailrefreshc URXS9nUR5nUR"U4X4S.UD6nU(aU$UVs/sHoSPM sn$![a UR(d [ US5 UR"UR U54X4S.UD6nUVs/sHoSU:XdM UPM Os snfnn[U5S:Xa [ US5 Nf=fs snf)aG List the contents of a directory. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.ls). > [!WARNING] > Note: When possible, use `HfApi.list_repo_tree()` for better performance. Args: path (`str`): Path to the directory. detail (`bool`, *optional*): If True, returns a list of dictionaries containing file information. If False, returns a list of file paths. Defaults to True. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to list from. Returns: `list[Union[str, dict[str, Any]]]`: List of file paths (if detail=False) or list of file information dictionaries (if detail=True). r)rr-Nnamer)rr?_ls_treerr.rrlen) r<rrrr-rVroutos r>lsHfFileSystem.lss4))$)B &&( 2--SgSFSCs:c":cV9c"::" 2 --%dD1-- T 2aGaZ`aC!7cvY$%61c7C73x1}%dD1 2#;s*AC"AC# B:3B:9#CCc < UbUOURb UROSnURXS9nUR5n[URUR UR SURS9R5n/n XR;GaU(GdURUn U RU 5 /n U(aSn [U V s/sHoSS:XdM X4PM sn 5nU(aUR5upUbX::a}USUR;aU RUS5 OUURUSn U RU 5 URU V s/sHn U SS:XdMU S -U 4PM sn 5 U(aM/nU(a,U Vs/sHnUS bM URUS5PM! nnU(aU (dU(Ga_U(GaW[RR!U U-5nUR#S 5(dUU:XdU[%U U5;aUR'S 5OURU5nUb"U[)U5SR+S 5nUU-nU Vs/sH#nUSR-US -5(aM!UPM% n n[/UR5H:nUR-US -5(dMURR1US5 M< URR1US5 U RUR3UUS UUUS 95 U $UR4R7UR UR8UUUR URS9nUHn US -U R-n[;U [<5(a=UU R>SU R@U RBU RDU RFS.nOUSSU RHU RDS.nURUS5nURRKU/5RU5 U[)U5SR+S 5n UbX::dMU RU5 M U $s sn fs sn fs snfs snf)NFrr4r.r1rrc directoryrr last_commitr6T)rrr-r|r)rexpandr-r+filersizercblob_idlfsrsecurityrrrrctree_idr)&r|rr?r)r+r,r-r1rextendrpopleftappendrosr commonprefixendswithr r9rr startswithlistr[rrlist_repo_treer.rr"rrrrrr setdefault)r<rrrr-r|rr root_pathrcached_path_infosdirs_not_in_dircachedepth path_info dirs_to_visitdir_infodirs_not_expandedr common_prefix common_pathcommon_path_depth cached_pathtree cache_pathcache_path_info parent_paths r>rHfFileSystem._ls_trees'2KTM]M]Mi9I9Iot ))$)B &&(,  # #  ! !  " "'55  )+  ==  $ d 3  JJ( )#%  %9Jo9JIX^N_cnNn'e'9Jo! $&3&;&;&=OE'5+<#F+4==@0778HI04 hv>N0O-JJ'89)006G!"5F '0'8K'G%;UQY $:5F!"$m !# FI$fcQ}M]%# URXRS5S9R5n[TU]"U/UQ70UD6ShvN gN7f)a Return all files below the given path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.walk). Args: path (`str`): Root path to list files from. Returns: `Iterator[tuple[str, list[str], list[str]]]`: An iterator of (path, list of directory names, list of file names) tuples. r-rN)rr8r?rQwalk)r<rrUrVrWs r>rHfFileSystem.walkHsI   :0F GQQS7<6t6v666sAAA Ac >URXRS5S9R5n[TU]"U4SU0UD6$)a( Find files by glob-matching. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.glob). Args: path (`str`): Path pattern to match. Returns: `list[str]`: List of paths matching the pattern. r-rr)rr8r?rQglob)r<rrrVrWs r>r HfFileSystem.globXsC   :0F GQQSw|D>8>v>>rAwithdirsc ~UbUS:a [S5eURXS9nUR5nUR"U4SXXRUS.UD6n U(dU V s/sHoSS:wdM U PM n n O0UR "U4SUR0UD6n U SS:XaU /U -OU n U V s0sHoS U _M n n [U 5n U(dU $U V s0sHoX_M sn $s sn fs sn f![ a; UR "U4SU0UD6SS :XaU00n N`0n Nd![a 0n Nsf=ff=fs sn f) aE List all files below path. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.find). Args: path (`str`): Root path to list files from. maxdepth (`int`, *optional*): Maximum depth to descend into subdirectories. withdirs (`bool`, *optional*): Include directory paths in the output. Defaults to False. detail (`bool`, *optional*): If True, returns a dict mapping paths to file information. Defaults to False. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to list from. Returns: `Union[list[str], dict[str, dict[str, Any]]]`: List of paths or dict of file information. rzmaxdepth must be at least 1rT)rrr-rrcrr-rr) rrr?rr-inforFileNotFoundErrorr)r<rrr rrr-rVrrrrnamesrs r>findHfFileSystem.findhsy@  HqL:; ;))$)B &&( .-- $g@V@VaimsC"%B#Q6k)Aq#B!IIdV]5K5KVvV +4V+< +KykC'QT),-AV9a<C-s L056#)O6 6C .!"  99T?H??G6Q*CC$   *7sG!C2! C(1C(.C-D:2 D7= D#D## D3/D72D33D7path1path2c URXS9nURX#S9nURUR:H=(a URUR:HnU(aSUSU3nURR URURUR UR SU5UR SS5[URURUR S9/S9 OURUS UR S9n U R5n S S S 5 SUSU3nURRW URURURURUR UR SU5UR S5S 9 URUR5S 9 URUR5S 9 g !,(df  N=f) aB Copy a file within or between repositories. > [!WARNING] > Note: When possible, use `HfApi.upload_file()` for better performance. Args: path1 (`str`): Source path to copy from. path2 (`str`): Destination path to copy to. revision (`str`, *optional*): The git revision to copy from. rzCopy z to rrr4)src_path_in_repor. src_revision)r,r+r-rrrrbNpath_or_fileobjr.r,rzr+r-rrr)rr+r,rrr-r8rr.openread upload_filerzrr?) r<rrr-rVresolved_path1resolved_path2 same_reporfcontents r>cp_fileHfFileSystem.cp_files **5*D**5*D  $ $(@(@ @ u^E[E[_m_u_uEu  $UG4w7N II # #&..(22'00%zz*:NK#)::.BB#G')7)D)D%3%@%@%3%<%< $ 5$1H1HIQ&&(J$UG4w7N II ! ! '+88&..jj(22'00%zz*:NK#)::.B#C "  >#;#;#=> >#;#;#=>JIs G G"c DUR"U400UESS0ED6nUSS$)a) Get the last modified time of a file. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.modified). Args: path (`str`): Path to the file. Returns: `datetime`: Last commit date of the file. r|Trdater)r<rrVrs r>modifiedHfFileSystem.modifieds4yyA!@F!@M4!@AM"6**rAc URXS9nUR5nURSURb UROS5nUR(d|USSSS.nU(alUR R URURURS9S n0UES[URURURS 9S .EnGOSnURU5n U(d XR;aUR!U 5 XR;aAURU V s/sHoS U:XdM U PM n n U (d [#US5 U SnU(dUbU(GaXU(GaPUS GcIUR R%URURUURURS9n U (d [#US5 U Sn ['URURURSUR(S9R5n[+U [,5(aMUS-U R.-U R0SU R2U R4U R6U R8S.nO,US-U R.-SSU R:U R6S.nU(dSVs0sHoX_M nnUceU$s sn fs snf)a Get information about a file or directory. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.info). > [!WARNING] > Note: When possible, use `HfApi.get_paths_info()` or `HfApi.repo_info()` for better performance. Args: path (`str`): Path to get info for. refresh (`bool`, *optional*): If True, bypass the cache and fetch the latest data. Defaults to False. revision (`str`, *optional*): The git revision to get info from. Returns: `dict[str, Any]`: Dictionary containing file information (type, size, commit info, etc.). rr|NFrr)rrrcr)r+r-)oidtitler')rrrr)rr-r+r4rr6rrr)rrrc)rr?r8r|r.rlist_repo_commitsr,r+r-r! commit_idr. created_atrrrrget_paths_infor)r1rr"rrrrrrr)r<rrr-rVrr|rrrrout1 paths_inforrks r>rHfFileSystem.infos*))$)B &&(jj t/?/?/K4++QV ))## C "ii99!))]5L5LWdWmWm: ##1'119J9JQ\QgQg$C,,t,K;mm#C $mm+#'==#=S#=a6dAR#=S)$51g#++##mBTB\!YY55!))!..&*33+55 6 ")$5&qM 4!++!))!**!#"/"="=  )+ i22 )C).. @ ) &#,#4#4(}}'0'<'<$-$6$6C!*C).. @ ! +#,#4#4'0'<'< C#.FG.Fcf9.FCG WTRHs2 KK<Kc URSS5(aURU5 UR"U40UD6 g! g=f)aq Check if a file exists. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.exists). > [!WARNING] > Note: When possible, use `HfApi.file_exists()` for better performance. Args: path (`str`): Path to check. Returns: `bool`: True if file exists, False otherwise. rFT)r8rr)r<rrVs r>existsHfFileSystem.existsQsD  zz)U++%%d+ IId %f % s ;>AcRURU5SS:H$![a gf=f)a) Check if a path is a directory. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.isdir). Args: path (`str`): Path to check. Returns: `bool`: True if path is a directory, False otherwise. rcrF)rOSErrorr<rs r>rHfFileSystem.isdirjs1 99T?6*k9 9  s  &&c@URU5SS:H$! g=f)a  Check if a path is a file. For more details, refer to [fsspec documentation](https://filesystem-spec.readthedocs.io/en/latest/api.html#fsspec.spec.AbstractFileSystem.isfile). Args: path (`str`): Path to check. Returns: `bool`: True if path is a file, False otherwise. rcrFr(r<s r>isfileHfFileSystem.isfile|s) 99T?6*f4 4 scURU5n[URURURUR UR S9nURU5(aURSSS5nU$)z Get the HTTP URL of the given path. Args: path (`str`): Path to get URL for. Returns: `str`: HTTP URL to access the file or directory on the Hub. )r+r-ryz /resolve/z/tree/r) rrr,r.r+r-ryrreplace)r<rrurls r>rCHfFileSystem.urlsq))$/   ! !  & &#--"++]]   ::d  ++k8Q7C rAc 6>URS5n[UR55S1- n[U[[ 45(a[ U5S:a[T U] "X4X4S.UD6$[U5(aUnO,URU5(a[R"USS9 g[U[[45(a2[R"[RR!U5SS9 SnUc[#US5nSnUR%5n UR'XS 9n UR)XS 9S n UR+U 5 [-[/U R0U R2U R4U R6UR8S 9UUU SUR:R=5[U[ 5(a UR>OSS 9 URAU 5 U(aURC5 gg!U(aURC5 ff=f) a Copy single remote file to local. > [!WARNING] > Note: When possible, use `HfApi.hf_hub_download()` for better performance. Args: rpath (`str`): Remote path to download from. lpath (`str`): Local path to download to. callback (`Callback`, *optional*): Optional callback to track download progress. Defaults to no callback. outfile (`IO`, *optional*): Optional file-like object to write to. If provided, `lpath` is ignored. r-r)callbackoutfileT)exist_okNFwbrrr,r-filenamer+ry)rC temp_filedisplayed_filename expected_size resume_sizeheaders _tqdm_bar)"r8setkeysrrrrrQget_filerrrmakedirsrHr rdirnamertellrrset_sizerrr,r-r.r+ryr_build_hf_headerstqdmseekclose) r<rpathlpathrFrGrVr-unhandled_kwargs close_file initial_posresolve_remote_pathrNrWs r>rTHfFileSystem.get_files$::j)v{{}- <(\<$@AASIYEZ]^E^7#E_8_X^_ _ e  G ZZ   KK - ec4[ ) ) KK. > ?5$'GJlln #///I % ;FC -( /770990==1;;!]] "#(+ 335+5h +M+M(--SW  LL % z s BG>>Hc[S5e)zA context within which files are committed together upon exit Requires the file class to implement `.commit()` and `.discard()` for the normal and exception cases. (Transactional commits are not supported.rr<s r> transactionHfFileSystem.transactions""LMMrAc[S5e)z@Begin write transaction for deferring files, non-context versionrerfrgs r>start_transactionHfFileSystem.start_transactions""LMMrAcp[[U5URURUR 544$rP) make_instancercrirjrergs r> __reduce__HfFileSystem.__reduce__s9 J      $ $ &    rAcX[UR5[UR5S.$)N)rr)rrrrgs r>re HfFileSystem._get_instance_states& //78\8\/]  rA)rrr{rryr|rzrP)rNN)FNN)TFN)FFNNN)NFFFN)FNr2N)2rCrDrErFrG root_markerprotocolrrHrboolintrR classmethodr\tuple Exceptionrr)rrrrrrdictr rrr rr rr$rr)rr8rr?rCrrTpropertyrhrkrorerJrsrts@r>rvrvts(.`KH #'(,$(&* <3-<T3_% < SM < d^ <<0    TT'*T6>smT tXi(( )T&]t]t ]tIa]t~Xc]d>$("& XXXSM X 3- X ; <X$ > >x} >$ >  "&"& ,>,>,>3- ,> 3- ,> ,>^`d&;&;!%&;7;&;OWX[}&; eCc3h'( )&;V "&&*"&www w 3- w d^ w3-wr77(5d3iQUVYQZAZ;[2\7 ?? ?4PS9??&#'"&=7=73-=7 =7  =7  =73-=7 tCy$sDcN233 4=7~6?S6?6? 6?[_6?p+S+x+ ``t`x}`bfgjlogobp`D2$$./@B B HNNN    rArv) metaclassc^\rSrSrSS\S\S\\4U4SjjjrU4SjrS\ S \ S \ 4S jr SS jr SS \ S S4SjjrSU4SjjrS \4SjrSrU=r$)ri Nfsrr-c >URX#S9Ul[TU]"XRR 540UD6 U g![a+nSURSS5;a[US35UeeSnAff=f)Nrwrr4B. Make sure the repository and revision exist before writing data.)rrrr8rQrRr?)r<rrr-rVrrWs r>rRHfFileSystemFile.__init__ s !#!ID  //99;FvF ! fjj,,'c\]   sA A8 &A33A8cD>[US5(dg[TU] 5$Nr)hasattrrQ__del__r<rWs r>rHfFileSystemFile.__del__s t_-- w  rAstartendr2cSSUSUS- 30URRR5En[URR URR URRURRURRS9n[SXC[RS9n[U5 UR$)Nrangebytes=-rrJGETrPr)rrrYrrr,r-r.r+ryr%rHF_HUB_DOWNLOAD_TIMEOUTr$r#)r<rrrPrCrs r> _fetch_rangeHfFileSystemFile._fetch_ranges veWAcAgY/ ggll,,. &&..''00''44((22WW%%   i>_>_ `AyyrAc8[R"SSS9Ulg)Nzhffs-F)prefixdelete)tempfileNamedTemporaryFilerLrgs r>_initiate_upload!HfFileSystemFile._initiate_upload-s!44GERrAfinalc HURRS5 URR5nURR U5 U(GaJURR 5 UR RRURRURRURRUR RURRURRUR R#S5UR R#S5S9 [$R&"URR5 UR R)URR+5S9 gg)Nrrrrr)bufferr[rrLwriter\rrrrrr.r,rzr+r-rVr8rremoverr?)r<rblocks r> _upload_chunkHfFileSystemFile._upload_chunk0s"    " U#  NN " GGLL $ $ $ 3 3!//<<**22ggmm,,66++44#{{/?@#';;??3G#H %  IIdnn)) * GG $ $''113 %  rAcT>URS:XaxUbUS:XaoURS:Xa_URRURSSS9nUR 5nU=R[ U5- slUsSSS5 $[TU]U5$!,(df  N=f)zRead remote file. If `length` is not provided or is -1, the entire file is downloaded and read. On POSIX systems the file is loaded in memory directly. Otherwise, the file is downloaded to a temporary file and read from there. rNr,r)r{)rlocrrrrrrQ)r<lengthr"rrWs r>rHfFileSystemFile.readEs 99 &.FbLdhhRSmdii!<ffhCH$=<w|F## =rCHfFileSystemFile.urlRww{{499%%rA)rrLrPrs)Fr,)rCrDrErFrvrHrrRrrwbytesrrrvrrrCrJrsrts@r>rr st < s hsm  ! #CE S4D* $&S&&rArc ^\rSrSrSS\S\S\S\\S\S\4 U4SjjjrSS \S \4S jjr SS \4S jjr S\4Sjr U4Sjr Sr SrSrU=r$)riVrrrr-r{ cache_typec >US:wa[SU35eUS:wa[SU35eSU;a[SUS35eURX$S9UlURR 5SS .Ul[T U] "XRR 54X5US .UD6 SUl U [5Ul g![a/nSUR S S 5;a[US 35UeSnANSnAff=f)Nrz:HfFileSystemStreamFile only supports block_size=0 but got nonez?HfFileSystemStreamFile only supports cache_type='none' but got rz;HfFileSystemStreamFile only supports reading but got mode=''rrr4r)rrrr{r) rrrrr8r?detailsrQrRresponser _exit_stack) r<rrrr-r{rrVrrWs r>rRHfFileSystemStreamFile.__init__Ws ?YZdYefg g  ^_i^jkl l $;Z[_Z``abc c !#!ID !% 2 2 < < >M   "",,. 59]g kq 37  $;! fjj,,'c\]- sB;; C4%C//C4rwhencec^US:XaUS:XagXR:XaUS:Xag[S5e)NrrzCannot seek streaming HF file)rr)r<rrs r>r[HfFileSystemStreamFile.seekws0 !8!  ((?v{ 899rArcrURcUR5 SnURcg[URU5nU=R[ U5- slU$![ aD URbURR 5 U(aeUR5 SnOf=fM)zRead the remote file. If the file is already open, we reuse the connection. Otherwise, open a new connection and read from it. If reading the stream fails, we retry with a new connection. FTrA)r_open_connection _partial_readrrrzr\)r<r retried_oncers r>rHfFileSystemStreamFile.read~s ==  ! ! #  $==(#DMM6:CH$  $==,MM'')%%'#  $s A&5A&&A B43B4r2cLURRUR5$rPrrgs r>rCHfFileSystemStreamFile.urlrrAcx>[US5(dgURR5 [TU]5$r)rrr\rQrrs r>rHfFileSystemStreamFile.__del__s2t_--   w  rAc[URURURURUR R 44$rP)reopenrrr blocksizecacherrgs r>ro!HfFileSystemStreamFile.__reduce__s0DIIt~~tzzWWWrAc [URRURRURRURR UR RS9nUR RR5nURS:aSURS3US'URR[SUU[RS95Ul[#UR 5 g ![$a,nUR R&S:Xa S UlS nAg eS nAff=f) z%Open a connection to the remote file.rJrrrRangerriN)rrr,r-r.r+rryrrYrr enter_contextr&rrrr$r status_code)r<rCrPrs r>r'HfFileSystemStreamFile._open_connections&&..''00''44((22WW%%  '',,002 88a!D98D99D>)rrrr)rNrr)rr)rCrDrErFrvrHrrwrRr[rrCrrorrJrsrts@r>rrVs "& ' '' ' 3- '  '''@::S:$3$8&S&!XrArr-r2cP[RU5(aU$[U5$rP)rr safe_quoters r>r;r;s#288BB8\ S[H\\rAsc[USS9$)Nr4)safe)r)rs r>rrs  rArrcUn[U[5(aUS3nO5[U[5(aUS3nO[U[5(aUS3n[ U5Ue)Nz (repository not found)z (revision not found)z (invalid repository id))rrrr#r)rrmsgs r>rrse C#.//-. C. / /+, C* + +./ C c)rArrr{rc"URXX4S9$)Nr)r)rrrr{rs r>rrs 774z7 QQrArrcZ[5nUS:a [S5eUS:XagUS:Xa3UR5HnURU5 M [ U5$URUS9H3nURU5 [ U5U:dM%[ USU5s $ [ U5$)zV Read up to `length` bytes from a streamed response. If length == -1, read until EOF. r,zlength must be -1 or >= 0rrA) chunk_sizeN) bytearrayr iter_bytesrrr)rrbufchunks r>rrs +C {455 { |((*E JJu +Sz$$$7 5 s8v Wf& &8 :rAc`U"U0UD6nUR5HupV[XEU5 M U$rP)rfrg)rTrUrVrorrprqs r>rnrns6 d f B+113+&4 IrAr)Urrerr] collectionsr contextlibrcopyr dataclassesrrr itertoolsr pathlibr typingr r r rr urllib.parserrfsspechttpxfsspec.callbacksrrr fsspec.utilsrr4r _commit_apirrerrorsrrrr file_downloadrrhf_apir r!r"utilsr#r$r%r&utils.insecure_hashlibr'compileVERBOSErr)rcAbstractFileSystemrKrIrMrvspecAbstractBufferedFilerrrHr;rrzrrwrResponserrrnhffsrBrAr>rs  (;;' JJ#Cff/33\\'!jj JJ  BB B,223 c3/l/dS 6,,S lI&v{{77I&XmV[[==m`]C]C]##**(9*=*(*R|R3RcRsRPSRENNC.~rA