*pjx%SSKJr SSKrSSKJr SSKJr SSKJr SSK J r J r J r J r SSKJrJrJrJrJr SS KJr SS KJrJr SS KJrJrJrJrJrJr \R@"S 5r!\RD"5r#\#RI\RJ"S 55 \&"\SS9r'S\(S'SSSjjr)SSSjjr*SSSjjr+SSSjjr,g)) annotationsN) lru_cache)PathLike)BinaryIO)coherence_ratioencoding_languagesmb_encoding_languagesmerge_coherence_ratios)IANA_SUPPORTEDIANA_SUPPORTED_SIMILARTOO_BIG_SEQUENCETOO_SMALL_SEQUENCETRACE) mess_ratio) CharsetMatchCharsetMatches)any_specified_encodingcut_sequence_chunks iana_nameidentify_sig_or_bomis_multi_byte_encodingshould_strip_sig_or_bomcharset_normalizerz)%(asctime)s | %(levelname)s | %(message)sc"[U5(+$N)rencodings R/var/www/html/pdf-tiff/venv/lib/python3.13/site-packages/charset_normalizer/api.pyr .s -CH-M)M)keyz list[str]IANA_SUPPORTED_MB_FIRSTc [U[[45(d#[SR [ U555eU(aB[ Rn [ R[5 [ R[5 [U5n U S:Xad[ RS5 U(a.[ R[5 [ RW 5 [[!USSS/S5/5$UbG[ R#[S S R%U55 UV s/sHn ['U S5PM nn O/nUbG[ R#[S S R%U55 UV s/sHn ['U S5PM nn O/nXU-::a![ R#[S UUU 5 S nU nUS :aX- U:a [)X- 5n[U5[*:n [U5[,:nU (a[ R#[SU 5 O"U(a[ R#[SU 5 /nU(a [/U5OSnUb,UR1U5 [ R#[SU5 [35n/n/n[35n[5SS9"[65n[5SS9"[85nSn[35nSnSnSnSnSnSn[5n[5n [;U5un!n"U!b7UR=SU!5 [ R#[S[U"5U!5 UR1S5 SU;aUR1S5 U[>-GHbn#U(aU#U;aMU(aU#U;aM"U#U;aM*URAU#5 Sn$U!U#:Hn%U%=(a [CU#5n&U#S;a$U%(d[ R#[SU#5 MU#S;a$U%(d[ R#[SU#5 MU#U;a[ R#[SU#5 M[EU#5n'U(afU'(d[3[KU#55n(O[3[MU#55n(U(ROU5(d [ R#[SU#U(U5 GMFU(a-U'(d&UU:a [ R#[SU#UU5 GMzU(a%U'(d[ R#[SU#5 GMU'(+=(a U(+n)U(a<U'(d5[QU&(dUS[)S5OU[U"5[)S5U#S9 OSU)(dLU#S :Xa'U%(a [QUU#S9n$U$(aU$SS!:XaU$S Sn$O[QU&(dUO U[U"5SU#S9n$[WU%(dSO [U"5U [)X- 55n+U'=(a U$SL=(a [U$5U :n,U,(a[ R#[S#U#5 [)[U+5S$- 5n-[YU-S%5n-Sn.Sn//n0/n1[[UU#U+UU%U&U"U'U$U)5 Hxn2U0R1U25 U1R1U"U2UU=(a S [U5s=:*=(a S%:*Os 55 U1S&U:aU.S - n.U.U-:dU%(dMoU&(aMx O U1(a[]U15[U15- OSn3U/(d7U(a0U'(d)U3U:a#U.U-:aU[)S)5SR_U#S*S+9 U3U:dU.U-:aUR1U#5 U#[`;aURc[`U#5 [ R#[S-U#U.[eU3S.-S/S095 U (aaU#SSUS1S24;aVU/(dOU$c)[QU&(dUO U[U"5SU#S9n$U(aSn$[!UU#UU%/U$US49n4U#U:XaU4nO U#S:XaU4nOU4nGMU)(a [QU&(dUO U[U"5SU#S9n$[ R#[S5U#[eU3S.-S/S095 U'(d [KU#5n5O [MU#5n5U5(a[ R#[S6U#U55 /n6U#S:wa>U5(aS7R%U55OSn7U0Hn2U"U2UU75n8U6R1U85 M [gU65n9U9(a[ R#[S8U9U#5 [!UU#U3U%U9U(a U#USS4;aU$OSUS49n:UR1U:5 U(aU'(d U3S9:aUS - nU#USS4;aU3S::azU3S:Xac[ RS;U:Rh5 U(a.[ R[5 [ RW 5 [U:/5s $U R1U:5 [U 5(aUbUU;aSU;a~SU;axU Rk5n;U;ce[ RS;U;Rh5 U(a.[ R[5 [ RW 5 [U;/5s $U(dcU'(d\U9(a[YS<U95SS=9OSn:a<SU;a6SU;a0S(nURcU55 [ R#[S?U#U3U<5 U(dnU'(agU,(a`U$b][U$5U S@-:aKU#SA;aESU;a?SU;a9S(n[ R#[SBU#U3[U$5U [U$5U - S.-5 U#U!:XdGM [ RSCU#5 U(a.[ R[5 [ RW 5 [UU#/5s $ [U5S:XaU(dU(dU(a[ R#[SD5 U(a2[ RSEURh5 UR1U5 OU(aUb+U(a!U(aURlURl:wdUb'[ RSF5 UR1U5 O-U(a&[ RSG5 UR1U5 U(a<[ RSHURk5Rh[U5S - 5 O[ RSI5 U(a.[ R[5 [ RW 5 U$s sn fs sn f![F[H4a [ R#[SU#5 G M/f=f![R[T4aWn*[U*[T5(d%[ R#[S"U#[QU*55 UR1U#5 Sn*A*G MSn*A*ff=f![R[T4axn*U)(a=[ R#[S"U#[QU*55 UR1U#5 Sn*A*G M[ R#[S'U#[QU*55 U-n.S(n/Sn*A*GNSn*A*ff=f![RaBn*[ R#[S,U#[QU*55 UR1U#5 Sn*A*G MoSn*A*ff=f![R[T4a [ R#[S3U#5 G Mf=f![R[T4aBn*[ R#[S"U#[QU*55 UR1U#5 Sn*A*G MSn*A*ff=f)Ja2 Given a raw bytes sequence, return the best possibles charset usable to render str objects. If there is no results, it is a strong indicator that the source is binary/not text. By default, the process will extract 5 blocks of 512o each to assess the mess and coherence of a given sequence. And will give up a particular code page after 20% of measured mess. Those criteria are customizable at will. The preemptive behavior DOES NOT replace the traditional detection workflow, it prioritize a particular code page but never take it for granted. Can improve the performance. You may want to focus your attention to some code page or/and not others, use cp_isolation and cp_exclusion for that purpose. This function will strip the SIG in the payload/sequence every time except on UTF-16, UTF-32. By default the library does not setup any handler other than the NullHandler, if you choose to set the 'explain' toggle to True it will alter the logger configuration to add a StreamHandler that is suitable for debugging. Custom logging format and handler can be set manually. z3Expected object of type bytes or bytearray, got: {}rzTrying to detect encoding from a tiny portion of (%i) byte(s).zIUsing lazy str decoding because the payload is quite large, (%i) byte(s).z@Detected declarative mark in sequence. Priority +1 given for %s.)maxsizezIDetected a SIG or BOM mark on first %i byte(s). Priority +1 given for %s.ascii>utf_16utf_32z\Encoding %s won't be tested as-is because it require a BOM. Will try some sub-encoder LE/BE.>utf_7zREncoding %s won't be tested as-is because detection is unreliable without BOM/SIG.zY%s is deemed too similar to a code page that was already considered unsuited. Continuing!z2Encoding %s does not provide an IncrementalDecoderzbSkipping %s: definitive match already found, this encoding targets different languages (%s vs %s).zXSkipping %s: already accumulated %d same-family results after definitive match (cap=%d).zCSkipping single-byte %s: multi-byte definitive match already found.gArr,uz9Code page %s does not fit given bytes sequence at ALL. %szpCode page %s is a multi byte encoding table and it appear that at least one character was encoded using n-bytes.zaLazyStr Loading: After MD chunk decode, code page %s does not fit given bytes sequence at ALL. %sTgj@strict)errorsz^LazyStr Loading: After final lookup, code page %s does not fit given bytes sequence at ALL. %szc%s was excluded because of initial chaos probing. Gave up %i time(s). Computed mean chaos is %f %%.d)ndigitsr*r+z>%s does not decode the whole payload: fallback entry withheld.)preemptive_declarationz=%s passed initial chaos probing. Mean measured chaos is %f %%z&%s should target any language(s) of %s,z We detected language %s using %sg{Gz?皙?z.Encoding detection: %s is most likely the one.c3*# UH upUv M g7fr).0_vs r from_bytes..s4#341Q#3s)defaultg?zyDefinitive match found: %s (chaos=%.3f, coherence=%.2f). Encodings targeting different language families will be skipped.g\(\?> r,r%r*r+ utf_16_be utf_16_le utf_32_be utf_32_le utf_8_sigzjMulti-byte definitive match: %s (chaos=%.3f, decoded=%d/%d=%.1f%%). Single-byte encodings will be skipped.zoEncoding detection: %s is most likely the one as we detected a BOM or SIG within the beginning of the sequence.zONothing got out of the detection process. Using ASCII/UTF-8/Specified fallback.z7Encoding detection: %s will be used as a fallback matchz:Encoding detection: utf_8 will be used as a fallback matchz:Encoding detection: ascii will be used as a fallback matchz]Encoding detection: Found %s as plausible (best-candidate) for content. With %i alternatives.z=Encoding detection: Unable to determine any suitable charset.)7 isinstance bytearraybytes TypeErrorformattypeloggerlevel addHandlerexplain_handlersetLevelrlendebug removeHandlerrrlogjoinrintrrrappendsetrrrrinsertr#addrrModuleNotFoundError ImportErrorr r intersectionstrUnicodeDecodeError LookupErrorrangemaxrsumdecoder updateroundr rbest fingerprint)= sequencessteps chunk_size threshold cp_isolation cp_exclusionpreemptive_behaviourexplainlanguage_thresholdenable_fallbackprevious_logger_levellengthcpis_too_small_sequenceis_too_large_sequenceprioritized_encodingsspecified_encodingtestedtested_but_hard_failuretested_but_soft_failuresoft_failure_skipcached_mess_ratiocached_coherence_ratiodefinitive_match_founddefinitive_target_languages post_definitive_sb_success_countPOST_DEFINITIVE_SB_CAPmb_definitive_match_foundfallback_ascii fallback_u8fallback_specifiedresultsearly_stop_results sig_encoding sig_payload encoding_ianadecoded_payloadbom_or_sig_availablestrip_sig_or_bomis_multi_byte_decoder enc_languagesdeferred_decodinger_multi_byte_bonusmax_chunk_gave_upearly_stop_countlazy_str_hard_failure md_chunks md_ratioschunkmean_mess_ratiofallback_entrytarget_languages cd_ratios lg_inclusionchunk_languagescd_ratios_merged current_matchprobable_resultbest_coherences= r from_bytesr2s< i)U!3 4 4 A H HY   %+\\/*i.F { ST    1 OO1 2|IwUBPRSTUU  5 IIl #  8DD| "e,| D    6 IIl #  8DD| "e,| D   u$%  l       qyV^j0( "%i.3E"E"%i.4D"D  L    W  (*.By)t%$$%78  N  uF)+)+"%% "$/ ;&t4_E$),/E -.$"#',*.N'+K.2,.G)7)9 3I >L+$$Q 5  W       )++$$W-.1HH M=  M\9  F "  =!&*%1]%B!5" :Q ;  0 09M JJn   I %.B JJd   - - JJk   *@*O ! "( #$6}$E F #$9-$H I  --.IJJ x!!/  #)04JJ JJj0&    %-B JJU  & % C.C*C * $-B 0"+CI.&s;'7#d)D* '!G+0D&)!!.'O'?1+=+I*9!"*=&)$4&!*3{+;+=!>!. 'O&)As;/?     " .t+ .O$v-   JJ-  "%SWq[!1 115 ! %!  5 ),$ %!   '  %!?A\):$?$?a$?R=I-$)$$(99((1A1A9 lENY#i.!@SV &%))+ #44 #d)+&--mH-M i '+;?P+P # * *= 9 66!(()? )NO JJ0 o+Q7   !W&8(HMN- #*!*-(8!*%.s;/?/A%B%2 +-*.!-!(#+="!$66)7&"g-%3N"0K   "% 0"&s;'7'9:* #$   K  /C' 3  %*<]*K 4]C   JJ8    G #/?)*D #"8& #   1#2)<  JJ2   %    .$);Wg(NN #5 " }% #)$& , 1 , 0'7C C#%#% D!**((9OO$9:%}o66  % %m 4 " # ##+/AV/K6!6!0557O". .. LL@(( $$_5 56!?"34 4&.C$4#34cB  $F):w&?P)-&+223CD P!#" *% +O$v}4  6!6!(, % JJ|O$O$v-3  L ( LL1  $$_5 56!7=#9":; ;mIp 7|q .,> JJa   LLI"++  NN- . ^3"++~/I/II' LLU V NN; '  LLU V NN> * k LLN # # L1   TU_--. NwEEx$[1  JJD    H#K0 a-- O!F  $ * *= 9  N    )! O!F  (..}= JJsA   1 $( !/ )L&  t!F  (..}= V/ <! !\) ! !P' 4  O!F  (..}= s.u :u%8 u*&Av)3vvA?xx"x$x)z {!|*+vvx-A w??xz=z )z  z {6{{!+||}&$6}!!}&c F[UR5UUUUUUUUU 5 $)zz Same thing than the function from_bytes but using a file pointer that is already ready. Will not close the file pointer. )rread) fprirjrkrlrmrnrorprqs rfrom_fpr*s5      r!c x[US5n [U UUUUUUUUU 5 sSSS5 $!,(df  g=f)z Same thing than the function from_bytes but with one extra step. Opening and reading given file path in binary mode. Can raise IOError. rbN)openr) pathrirjrkrlrmrnrorprqrs r from_pathrHsB dD R              s+ 9c [U[[45(a[UUUUUUUUUU S9 n U (+$[U[[ 45(a[ UUUUUUUUUU S9 n U (+$[UUUUUUUUUU S9 n U (+$)a Detect if the given input (file, bytes, or path) points to a binary file. aka. not a string. Based on the same main heuristic algorithms and default kwargs at the sole exception that fallbacks match are disabled to be stricter around ASCII-compatible but unlikely to be a string. ) rirjrkrlrmrnrorprq)rEr]rrrGrFrr) fp_or_path_or_payloadrirjrkrlrmrnrorprqguessess r is_binaryrgs"'#x99 !!%%!51+  Z;C       !!%%!51+  4; !!%%!51+  ;r!) 皙?NNTFr7T)rhzbytes | bytearrayrirUrjrUrkfloatrllist[str] | Nonermrrnboolrorrprrqrreturnr)rrrirUrjrUrkrrlrrmrrnrrorrprrqrrr)rzstr | bytes | PathLikerirUrjrUrkrrlrrmrrnrrorrprrqrrr) rrrNNTFr7F)rz!PathLike | str | BinaryIO | bytesrirUrjrUrkrrlrrmrrnrrorrprrqrrr)- __future__rlogging functoolsrosrtypingrcdrr r r constantr r rrrmdrmodelsrrutilsrrrrrr getLoggerrK StreamHandlerrN setFormatter Formattersortedr#__annotations__rrrrr9r!rrs" 0   / 0'') AB&,M&%)%)!% # u  u  u u  u  # u  # u u u u u u t%)%)!% #    #  # @%)%)!% #       #  #       B%)%)!% #!?<? ?? ? # ? # ????? ?r!