Ipj0|SrSSKrSSKrSSKrSrSrSrSrSrSr S r S r S S .S jr Sr SrSS.SjrSrSrSrSrSrSCSSSSS.SjjrSrSrSrS S!S"S#S$.S%jrS&rSS'.S(jrSSS).S*jrS S!S"S#SS+.S,jrS-rS.rS/r S0r!S1r"S2r#S3r$S4S5S6.S7jr%S4S8S5S9.S:jr&SS;.S<jr'S5S4S8S=.S>jr(SS5S?.S@jr)SAr*SBr+g)Da Copyright (C) 2023 Artifex Software, Inc. This file is part of PyMuPDF. PyMuPDF is free software: you can redistribute it and/or modify it under the terms of the GNU Affero General Public License as published by the Free Software Foundation, either version 3 of the License, or (at your option) any later version. PyMuPDF is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU Affero General Public License for more details. You should have received a copy of the GNU Affero General Public License along with MuPDF. If not, see Alternative licensing terms are available from the licensor. For commercial licensing, see or contact Artifex Software, Inc., 39 Mesa Street, Suite 108A, San Francisco, CA 94129, USA, for further information. --------------------------------------------------------------------- PyMuPDF table grid refinement (opt-in extension). Provides the refine_grid / refine_grid_structure / refine_grid_rows API that refines a detected table's cell grid using page text and vector-graphics geometry. Re-exported by pymupdf.table; never runs on the default find_tables() path. Ng@c </nURS5nURS/5HnURS5S:waMURS/5HnURS5nURS5nURS/5HnS RS URS /555nUR5(dMBUR URS /5V s/sHn [ U 5PM sn UUUS .5 M M M U$s sn f)zFlattened rawdict text spans carrying line-direction metadata. Only used to locate vertical/rotated text so those words can be replaced by span-level bboxes in _refine_page_words. Minimal fields (bbox/text/dir/wmode) -- the only ones the consumers read.rawdictblockstyperlinesdirwmodespansc3X# UH n[URSS55v M" g7f)cr N)strget.0chars Q/var/www/html/pdf-tiff/venv/lib/python3.13/site-packages/pymupdf/_table_refine.py (_refine_rawdict_spans..Fs%XBW$s488C#455BWs(*charsbbox)rtextrr )get_textrjoinstripappendfloat) pager rawblockline directionr spanrvs r_refine_rawdict_spansr%7s E -- "C2& 99V  ! IIgr*DIHHW%E"-wwX$((7TVBWXXzz|| 3788FB3G H3Gaq3G H $(!&  .+'$ L !Is*Dc8URS5S;agURS5n[U[[45(a[ U5S:ag[ [ US55n[ [ US55nX2:$![[4a gf=f) zTrue when a rawdict span's direction indicates non-horizontal text flow. wmode != 0 is vertical; otherwise compare |dir_x| vs |dir_y| (a missing or unparsable direction counts as horizontal).r NrTrFr) r isinstancelisttuplelenabsr TypeError ValueError)r#r"dxdys r_refine_is_vertical_or_rotatedr3Ts  xx )I i$ / /3y>A3E y|$ % y|$ % 7N z "s.BBBc ^[USS5nUbU$URS5Vs/sHin[US5R5(dM&[ US5[ US5[ US5[ US5[US54PMk nn[ U5Vs/sHOn[ U5(dM[URS 5=(d S 5R5(dMMUPMQ nnU(Ga=UVs/sH1n[R"URS 5=(d /5PM3 nn/nUHWnUuppn [R"X-S -X-S -5m[U4S jU55(aMFURU5 MY [XV5HupNUR(aMUR[ UR5[ UR 5[ UR"5[ UR$5[US 545 M ['USS9n[)USU5 U$s snfs snfs snf![*a U$f=f)a%Center-point word list for grid refinement, cached on the page object. Extract page words once (page.get_text("words")), then substitute vertical/ rotated text: any horizontal word whose center falls inside a rotated span's bbox is dropped, and each rotated span is appended as a single word._refine_words_cacheNwordsrr)r(rr r?c3j># UH(oR(aMURT5v M* g7fN)is_emptycontains)rrectcenters rr%_refine_page_words..s$X]T--(4==((]s33cUSUS4$Nr)ritems r$_refine_page_words..stAwQ.@key)getattrrrrrr%r3rpymupdfRectPointanyrzipr<x0y0x1y1sortedsetattr Exception)rcachewr6r# rotated_spans rotated_rectskeptwordwx0wy0wx1wy1_r>r?s @r_refine_page_wordsrcfs# D/ 6E  w' 'A qt9??  HqteAaDk51;ad S1YG'  *$//D )$ / 478H8NB4O4U4U4W / JWX-$dhhv&6&<"=- XD$( !Cc]]CI#4syC6GHFX]XXX KK   m;JD}} KKtwwtwwtwwtwwQTUYZ`UaQbc < t!@A +U3 L=   Y"   L s6%IAI&I>4I6I 8I I"" I0/I0c|X-S-nX-S-n XHs=:*=(a U:*Os =(a XYs=:*=(a U:*$s $)zWord-to-cell membership by CENTER point (inclusive), not clip-overlap. A word straddling a column line is claimed by exactly one cell.r9rC) r^r_r`rarQrRrSrTcxcys r_refine_word_in_rectrgs< )s B )s B >>r> ,bnn"n,n,rHc>[UR5[UR5[UR5[UR54up#pE[ U5VVVV V s/sH!upgpn [ XgXX#XE5(dMXgXU 4PM# sn n nnn$s sn n nnnf)zGPage words whose center lies in rect, as (x0, y0, x1, y1, text) tuples.)rrQrRrSrTrcrg) rr>rQrRrSrTr^r_r`rars r_refine_words_in_rectris~477^U477^U477^U477^SNBB);4(@ (@ $Cc #BB C #3T"(@  s 'B  B c^[[R"SUR555$)z8Loose value-like predicate: the text contains any digit.\d)boolresearchrrs r_refine_has_digitrps  %. //rHcUR5n[[R"SU55=(a [ SU55(+$)z=Strict value-like predicate: contains a digit and no letters.rkc3@# UHoR5v M g7fr;)isalphars rr-_refine_has_digit_no_alpha..s7\S[4 S[s)rrlrmrnrO)rstrippeds r_refine_has_digit_no_alpharvs7zz|H  %* + \C7\S[7\4\0\\rHffffff?) thresholdcUcgUSSup#n[U5U:=(a# [U5U:=(a [U5U:$![a gf=f)NTr8)rWr)fillrxrgbs r_refine_is_whiter~s_ |r(a 8i  QE!Hy$8 QU1X =QQ sA AAcUb)[R"U5nUR(dU$UVVs/sHOnUHEnUcM[R"U5R(aM/[R"U5PMG MQ nnnU(dg[R"US5nUSSHnURU5 M U$s snnfNrr))rLrMr< include_rect)cells table_bboxr>rowcellrectsrEs r_refine_table_rectrs||J'}}K CD  %,LL$6$?$?  T     <<a !Dab  $ K s C #C *C c /n[URR5nUR5Hn[ UR S55(aM$UR S/5HnUSS:waM[ R"US5nUR5 URSU-:aMLURU:dURU:aMnXq-R(aMURU5 M M U$)Nrzitemsrrmr)rw) rr>width get_drawingsr~rrLrM normalizeheightr<r)r table_rectmin_dimout page_widthdrawingrEr>s r_refine_raw_shaded_rectsrs Ctyy'J$$& GKK/ 0 0 KK,DAw$<<Q(D NN zzTJ..zzG#t{{W'<!++ JJt -' JrHg?) contain_fracc^^^^/n[U5HYummTR5mTS::aM[UUUU4Sj[U555nU(aMHURT5 M[ U$)Nrc3># UHIupUT:g=(a6 TU-R5TT-:=(a UR5TS-:v MK g7f)g?N)get_area)r other_indexotherarearindexr>s rr0_refine_cell_background_rects..s` ';"  5  /'')\D-@@ / 4$;. /';sAA) enumeraterrOr) raw_rectsrkeepnestedrrr>s ` @@@r_refine_cell_background_rectsrsh D + t}} 19  '0 &:    v KK , KrHc"/n/n[U5HNnU(a3XCS- U:a(UR[U5[U5- 5 /nURU5 MP U(a&UR[U5[U5- 5 U$)N)rUrsumr-)values toleranceclusterscurrentvalues r_refine_clusterrsxHG ur{*Y6 OOCL3w<7 8Gu  G s7|34 OrHcX[5n[5nUR5GHlnURS5S;nURS/5GH=nUSnUS:XGaUSUSp[URU R- 5S:a[UR U R - 5S :azUR S - URU R-S -s=:aURS -:a9O O6UR[URU R-S -S55 O[UR U R - 5S:a[URU R- 5S :ayURS - UR U R -S -s=:aURS -:a8O O5UR[UR U R -S -S55 GMUS :waGM[R"US5n U R5 X-R(aGMU R S :aHU R"S :a8UR[U R U R-S -S55 GMGU R"S :aHU R S :a8UR[U RU R-S -S55 GMU(dGMUR[U R S55 UR[U RS55 UR[U RS55 UR[U RS55 GM@ GMo [%U5[%U54$) Nr)sfsrrlr)r(?g$@@r9rm)setrrr.yxrRrTaddroundrQrSrLrMrr<rrrU) rrxsysrstrokedrEkindp1p2r>s r_refine_border_linesrs B B$$&++f%4KK,D7Ds{a$q'Brtt $s*BDD244K(4/" +rttbdd{c.AWJMMTWDWWFF5"$$+!4a89rtt $s*BDD244K(4/" +rttbdd{c.AWJMMTWDWWFF5"$$+!4a89t|<<Q(D NN !++{{S TZZ$%6udgg/36:;c!dkkD&8udgg/36:;uTWWa()uTWWa()uTWWa()uTWWa()?-'D ":vbz !!rHcr^^UV^s/sH"m[UU4SjU55(aM TPM$ sn$s snf)Nc3F># UHn[TU- 5T:*v M g7fr;)r.)rborderedgers rr$_refine_drop_near..(s"-d\cRXc$-.@I.M\cs!rO)edgesbordersrrs ``r_refine_drop_nearr's)" eUT#-d\c-d*dDU ee es44cUHcupgpn [U 5R5(dM'Xh-S-n Xy-S-n X-U s=:a X5- :dMHO MLX%-U s=:a XE- :dM_ g Me g)Nr9TF)rr) r6rQrRrSrTmarginr^r_r`rarrerfs r_refine_has_textr+sq$) #D4y  i3 i3  ; )bk ) )bkB.L.L/M %* rHc r^^^[UUU4SjU55nU(aT/UQTPnSn [[U5S- 5H n [XXXXU S-TS9(aMU n O U cU$U [U5:aUR U 5 O!U S- S:aUR U S- 5 OU$U(aMU$)Nc3Z># UH nTT-Us=:a TT- :dMO MUv M" g7fr;rC)rrrrRrTs rr3_refine_content_filter_row_edges..7s*SJD"v+2RrF{2R42R4Js ++ +r)rr)rUranger-rpop) r6rRrT candidatesrQrSrrbounds empty_indexrs `` ` r _refine_content_filter_row_edgesr6s SJS SE !u!b! 3v;?+E#Ev}bQRBS\bcc# ,    L U # IIk " 1_ ! IIkAo &  L % LrHrg@g@)cluster_tolerancerrborder_tolerancec [X5nUbU(dU$[XUS9n[U5n U (dU$[U V V s/sH6n [ U R 5[ U R 54HoPM M8 sn n US9n [X5up[XUS9n U (dU$[U5n/nSnUGH|nUVs/sHnUcM[R"U5PM nnU(dURU5 MI[SU55n[SU55n[SU55n[SU55n[UUUU UUUS 9nU(dURU5 MU/UQUPn[![#U5S - 5Hn/nUHsnUcURS5 M[R"U5n UR[ U R$5UU[ U R&5UUS -/5 Mu URU5 M U[#U5S - - nGM US::aU$U$s sn n fs snf) a/Split rows the line grid merged but a cell background rectangle separates. Cell background-shading rectangles give row boundaries the border lines do not; candidate y-edges from those rectangles (minus edges that coincide with real borders, minus edges that would cut an empty band) subdivide each row.N)r)rrc3L# UHn[UR5v M g7fr;)rrRrrs rr%_split_shaded_rows..s2TT%..T"$c3L# UHn[UR5v M g7fr;)rrTrs rrrtrrc3L# UHn[UR5v M g7fr;)rrQrs rrrurrc3L# UHn[UR5v M g7fr;)rrSrs rrrvrrrr)r()rrrrrrRrTrrrcrLrMrminmaxrrr-rQrS)rrrrrrrrrbackground_rectsr>ry_edges _border_xs border_ysr6 new_cells added_rowsrrlivery0ry1rx0rx1cutsr band_indexbands r_split_shaded_rowsrJs1$E6J (7KI4Y?  *X*$dggdgg7Wt7W*X#G1BJ>NOG  t $EIJ/2Gstd" T"sG   S ! 2T222T222T222T22/sC#s[ab   S ! ""c"F a0JD<KK%"<<-DKKtww );U477^VT^abTbMcd    T "1 c&kAo% 36Q Q YHs=I =IIc[U5$r;)rvros r_refine_value_likers %d ++rHc[U5$r;)rpros r_refine_span_value_likers T ""rHc T[R"U5n/n[X5Hupgpn [U 5R 5n U (dM)[ U5[ U5-S- n [ U5[ U 5-S- n UR U s=::aUR::dMO MURU s=::aUR::dMO MUR[ U5[ U5X45 M [U5S:agURSS9 /nUS/nUSSH<nUSUS S- U:aURU5 U/nM+URU5 M> URU5 UHnURS S9 [[U5S- 5H~nUUS-SUUS- U::aMS RS USUS-55nS RS UUS-S55n[U5(dMk[U5(dM} g M g)zTrue if a cell holds two value-like groups separated by a wide gap on one text line -- the signal that a single grid column packs several columns.rr(Fc US$)Nr(rCrDs rrF*_refine_cell_span_signal..sQrHrIrr)Nrc US$r'rCrDs rrFrs47rH c3*# UH oSv M g7fr8NrCrr]s rr+_refine_cell_span_signal..sB0AG0Ac3*# UH oSv M g7frrCrs rrrsC1B!W1BrT)rLrMrirrrrQrSrRrTrr-sortrrr)rrgapline_tolerancer>r6rQrRrSrTrrurerfrrr]r!rleftrights r_refine_cell_span_signalrs << D E 5d At9??$ Bi%)#s *Bi%)#s * 77b #DGG # #2(@(@(@ LL%)U2Y= >!B 5zA~ JJ'J( EQxjGab  7WR[^ #n 4 LL !fG NN4   LL * +3t9q=)EEAIq!DKN2c988B[uqy0ABBDHHCeaik1BCCE&t,,1H1O1O * rHg(@g@g333333?r(rr support_ratio min_supportc &^ [U5n[U[XF-55m 0nUHDn[U5H2upU cM [ X X#S9(dMUR U S5S-Xy'M4 MF [ U 4SjUR555$)zReturn the column indices that fire the under-segmentation gate: columns where enough rows carry the two-value-group signal (a support threshold).)rrrr)c3<># UHupUT:dM Uv M g7fr;rC)rcolcountsupport_thresholds rr._refine_detect_span_columns..sW(8*#EEVrQrRrSrTrrerfs r_refine_column_wordsrs D S>ch2<<)D(=d(I$4y((Bi%)+s2Bi%)+s277b+DGG++20H0H0HLL%)U2YD !BC )J F5M" KrHbridge_tolerancec ^[U5VVVVVs/sHup#UH upEodXR4PM M nnnnnn[U5S:a/$[SU55n[SU55n X- S:a/$/n Sn Un X::arUVVVs1sHupEo$U s=:aU:dMO MUiM n nnn[U 5U:aU bU R U SU S45 Sn O U cX/OU SU /n U S- n X::aMrU bU R U SU S45 /nU GHunnXS-::d UU S- :aMUU-S- m[ U4SjU55nUVs/sH!n[ U4S jU55(aMUPM# nnS=nnS=nnS=nn/n/nUHnUVVVs/sHupEnUT::dMUPM nnnnUVVVs/sHupEnUT:dMUPM nnnnU(a8US- nUS- nU[S RU55- nURU5 U(dMUS- nUS- nU[S RU55- nURU5 M US:dUS:aGMOUS:aB[S RU55(a[S RU55(dGMO#U(a UU- S :dU(a UU- S :aGMUR T5 GM [U5$s snnnnnfs snnnfs snfs snnnfs snnnf) Nr(c3,# UH un o!v M g7fr;rC)rrQrbs rr!_refine_cut_xs..s * HB1R sc3*# UH upov M g7fr;rC)rrbrSs rrrs * HA1R rr)rrrc3`># UH#n[U4SjU55(dMSv M% g7f)c3R># UHupo1Ts=:=(a U:Os v M g7fr;rCrrQrSrbcut_xs rr+_refine_cut_xs...$=e_dR[RTZ[5oo2oo_d$'r)Nr)rr6rs rrrs!fJ5#=e_d=e:eQQJs. .c3R># UHupo1Ts=:=(a U:Os v M g7fr;rCrs rrrrr rr9) rr-rrrrrOrrextendrU) rows_wordsr row_indexr6rQrSrb intervalslohichannelsrr crossing_rowsr left_edge right_edgecrossing_count body_rows left_rows right_rowsleft_okright_okleft_nright_n left_values right_valuesrrrrs @r_refine_cut_xsr6s$=Fz=Rl=R)9fkWbXZ`ab$fk$=RIl 9~ * * *B * * *B w{ HG A '."s+UcSUsr)defaultrr)) rrrr6rrrrr"r-rLrM)rrrr8ncols active_colscol_cutsr rrrnew_rowrrQrRrSrTrrrs r_refine_split_columnsrA!sl +U+Q 7E&.$C 4EKHU|  "s'= 24DWgh 4 SM   I"3IC<<$Dt$vTQ78!(d!3BTHuURUUHHB4O"3r7Q;/ENNBuIr2eai="#EF0( !  Is5E5 E5 E5 )rrrrrc X[UUUUUUS9nU(dU$[XU[U5S9$)zSplit under-segmented columns, but only those that fire the value-group gate -- so ordinary single-value columns are never disturbed.rr7)rrAr)rrrrrrr fired_colss r_split_undersegmented_columnsrDBsC-  %# J   &6S_ rHczUVVs/sH&oHo"cM[R"U5PM M( snn$s snnfr;)rLrM)rrrs r_refine_rects_from_cellsrF^s/*/ T%3CD GLL C % TT Ts 77cU(dg[R"US5nUSSHnURU5 M U$r)rLrMr)rr>rEs r_refine_union_rectrHbs=  <<a !Dab  $ KrHcB[US/S9n[SU55nU$)Nc<[SU55[U54$)Nc3.# UH ocMSv M g7fNr)rCrs rr?_refine_best_column_bounds....nsC34QQ3s )rr-)rs rrF,_refine_best_column_bounds..nsC3CCSXNrH)rJr<c3# UHfnUcM[R"U5nURUR:dM:[ UR5[ UR54v Mh g7fr;)rLrMrSrQr)rrr>s rr-_refine_best_column_bounds..qsVD  )\\$'D 77TWW  )twwtww(sA0.A01A0)rrU)rbest_rowrs r_refine_best_column_boundsrRks5 NH F MrHcU(d/$[USS9nUS//nUSSUSS-S- nUSSHFnUSUS-S- nXB- [:aURU/5 OUSRU5 UnMH /nUHynUR[S U55[S U55[ S U55[ S U55S R S[USS955S.5 M{ U$)zuGroup center-point words into body "lines" by a fixed center-y gap, returning each line's union bbox and joined text.c(USUS-S- US4$)Nr)r8rrrCrDs rrF,_refine_cluster_words_by_y..sT!WtAw->#,EtAw+OrHrIrr)r8rNrc3*# UH oSv M g7f)rNrCrs rr-_refine_cluster_words_by_y..6gdq'grc3*# UH oSv M g7f)r)NrCrs rrrWrXrc3*# UH oSv M g7f)r(NrCrs rrrWrXrc3*# UH oSv M g7frrCrs rrrWrXrrc3*# UH oSv M g7f)r7NrCrs rrrWs _5^Ta5^rc US$r'rCrDs rrFrUs VZ[\V]rH)rQrRrSrTr)rU_REFINE_LINE_GAPrrrr)r6r last_centerr]r?rclusters r_refine_cluster_words_by_yra{s  5O PEq |H8A;q!,3Kab q'DG#s*  "2 2 OOTF # RL   %  E 6g666g666g666g66 _VGI]5^ __    LrHc[5n[US5n[US5nX4-S- n[U5HHunupx[XH5[ X75- n U S:dXus=::aU::dM3O M7UR U5 MJ U$)NrQrSrr)rrrrrr) r! col_boundscolsline_x0line_x1r?rrQrSoverlaps r_refine_line_columnsrhs 5DDJGDJG3 &F$Z0xg"S%55 Q;",",, HHUO1 KrHc /n[UR5[UR5[UR5[UR54up4pV[ U5Hupxpn Xy-S-n X-S-n Xr6rrrrrQrRrSrTrrerfs r_refine_page_words_in_rectrjs EtwwtwwtwwtwwWCc 24 8g_g_     0S 0 0t9??$Dt eBirE"IuRy$OP !9 LrHcU(d/$[U5n[USS5[USS5//nUSSHupEUSnUS[U5- n[USUS- [U5[U5- 5nUS:a@Xx- U:a8[US[U55US'[US[U55US'MUR [U5[U5/5 M UVVs/sHupEXE4PM snn$s snnf)Nrr)r)rUrrrr) rfracrmergedrRrTrrg min_heights r_refine_merge_overlapping_linesros  5MEU1Xa[!5q!#56 7F)*!*uRy(gaj0%)eBi2GH >g2d:WQZr3GAJWQZr3GAJ MM59eBi0 1$* *6RH6 ** *s6D g333333?r)clean_thresholdheader_row_countc [U5nU(a([S[[U5[ U555OSn[S[ U5U- 5n[ U5U::ag[ U5S:ag[ [ XS55nUbUR(ag[X5n[U5nU(dg[S[ U5S-S-5n /n UH9n [[X55n [ U 5U :dM(U RU 5 M; [ U 5[ U5- n X:ag[ U 5U::agURURURUR /UVVs/sHup[#US5[#US5/PM snnU V s/sHn [%U S5[%U S5/PM! sn UUS.$s snnfs sn f)aiDecide whether the body rows are over-merged. Returns the geometry needed to re-cut them (body bbox, column bounds, per-record y-bounds) or None. Fires only when the body text clusters into clean multi-column "record" lines (clean_ratio >= clean_threshold) and there are more records than existing body rows -- i.e. several records collapsed into one grid row.r)rNr(rRrT) body_bboxrcrecord_line_boundsexisting_body_rowsrr)rRrrr r-rHrFr<rjrarUrhrrQrRrSrTrr)rrrqrrrcrv body_rectr6rmin_cols record_linesr!rd clean_ratiorQrSs r_refine_detect_row_overmerger{s,E2JINs1c#&6"7UDETUQE -= => 5z%% :"#;EBSs r_split_overmerged_rowsrs ( _ D |  T+./I7;L7IJ7IVR59eBi(7IJJ<@AU.Ss1Q41,rHrIc US$rLrCrs rrFrTs!A$rHNr)r(r8)rUr itertoolsgroupbyr-rr) rr rirrgridordered_y row_cellsrrs r_refine_cells_to_gridrIs  u%u!1u% &B"+B-0-$!-I0 DU 67G"**7G fs2wD',T!W~uT!W~uTRSW~W\]abc]dWe&fC$q'" # C H K&0s CC!c UVVs/sHHnUH>nUcM[US5[US5[US5[US54PM@ MJ snn$s snnf)zIFlatten a refined grid back to a Table's flat (x0, y0, x1, y1) cell list.rr)r(r8)r)rrrs r_refine_grid_to_cellsr\sf CD  ItAwtAwtAwtAwH I  s A>Ar;),__doc__rrmrLr^r%r3rcrgrirprvr~rrrrrrrrrrrrrrr6rArDrFrHrRrarhrjror{rrrrrrrCrHrrsfB :$'T-0 ])-R&*>A" %"Pf.A   AJ,#$PSQRX""45>B<=4J 8U  <  +"BFXY+^%)TTU&%T6:78bf ,0!*&rH