=pj SSKrSSKrSSKrSSKrSSKJr SSKJr SSKJ r J r J r J r J r SSKrSSKJr SSKJrJrJr SSKJrJr S rSFS \ \ \\4S \ \ \\4S \S \4SjjrS\R<S \ \R<\R<44SjrS\ \\ \ 4S\S \ \\ \ 44Sjr Sr!Sr"Sr#SGSjr$SHSjr%Sr&Sr'Sr("SS\5r)"SS\5r*S r+S!r,S"r-S#r.S$r/S%r0S&r1\Rd"\1S'\1S(3\RfS)9r4S*\4S+jr5S,r6S-\*4S.jr7S/\S \4S0jr8S1\4S2jr9S*\S \ \S44S3jr:SIS*\S4\S5\S \ \ \\\4S44S6jjr;SJS7\S8\S9\S4\S:\S \4 S;jjr\R|5r@\Rd"S?5rA\Rd"S?5rBS@\R<S \ \\ 44SAjrCSB\SC\SD\S \ \\ \\ 444SEjrDg)KN)Counter)deepcopy)AnyDictListTupleUnion)Image) BaseModelcomputed_fieldmodel_validator)calculate_overlap_ratio"calculate_projection_overlap_ratiocJUR(dURS5nU$)Nr)is_validbuffer)polys j/var/www/html/pdf-tiff/venv/lib/python3.13/site-packages/paddlex/inference/pipelines/paddleocr_vl/uilts.py make_validr!s =={{1~ Kpolygon1polygon2modereturncSSKJn U"U5nU"U5n[U5n[U5nUR U5R nUR U5R nUS:XaXg- $US:Xa$[UR UR 5nXh- $US:Xa$[UR UR 5n Xi- $[SU35e![a [S5ef=f)ah Calculate the overlap ratio between two polygons. Args: polygon1 (List[Tuple[int, int]]): First polygon represented as a list of points. polygon2 (List[Tuple[int, int]]): Second polygon represented as a list of points. mode (str, optional): Overlap calculation mode. Defaults to "union". Returns: float: Overlap ratio value between 0 and 1. r)PolygonzPlease install Shapely library.unionsmalllargezUnknown mode: ) shapely.geometryr ImportErrorr intersectionarearminmax ValueError) rrrrpoly1poly2r#r small_area large_areas rcalculate_polygon_overlap_ratior,'s =, H E H E u E u E%%e,11L KK  # #E w## UZZ0 (( UZZ0 ((>$011# =;<<=s CC&coordscUSS2S4nUSS2S4nUSS2S4nUSS2S4n[R"X1- XB- -5n[R"USS2S4USSS245n[R"USS2S4USSS245n[R"USS2S4USSS245n[R"USS2S4USSS245n [R"SX- 5n [R"SX- 5n X-n [R"USS2S4USSS245n [R"SSS9 [R "U S:X- S5nSSS5 X4$!,(df  WU4$=f) z Compute pairwise overlap ratio (mode="small") and bbox areas. This only replaces the numeric overlap/area calculation. The caller keeps the original sequential dropping order because it affects inline formulas. Nrrignore)divideinvalidg)npabsmaximumminimumerrstatewhere)r-x1y1x2y2areasinter_x1inter_y1inter_x2inter_y2inter_winter_h inter_arear*overlaps r_compute_pairwise_overlap_smallrGMsd 1B 1B 1B 1B FFBG( )Ezz"QW+r$'{3Hzz"QW+r$'{3Hzz"QW+r$'{3Hzz"QW+r$'{3HjjH/0GjjH/0G"JE!T'NE$'N;J Hh 7((:>:+BCH 8 > 8 7 E>s E// Flayout_det_reslayout_shape_modec[U5nUSVs/sHo3SS:wdM UPM nnU(dXBS'U$[R"UVs/sHo3SPM sn[RS9nUSS2S4USS2S4- nUSS2S 4USS2S 4- n[ U5up[ 5n [ [U55GHJn XkS :dX{S :aU RU 5 [ U S -[U55GHn X;dX;aMXU 4n XKSS :Xd XLSS :Xa@U S :a:XKSS :XaU RU 5 XLSS :XaU RU 5 MlU S:dMtUS:wa'SXK;a[XKSXLSS5nUS:aMXKSXLS1nU1Sk-(a[U5S :aSU;dU1Sk::aMXX:aU RU 5 MU RU 5 GM GMM [U5VVs/sHunnUU ;dMUPM snnUS'U$s snfs snfs snnf)a Remove overlapping boxes from layout detection results based on a given overlap ratio. Args: layout_det_res (Dict[str, List[Dict]]): Layout detection result dict containing a 'boxes' list. Returns: Dict[str, List[Dict]]: Filtered dict with overlapping boxes removed. boxeslabel reference coordinatedtypeNrrr0r/inline_formula?gffffff?rectpolygon_pointsr>sealchartimagetablerY) rr4arrayfloat64rGsetrangelenaddr, enumerate)rHrIlayout_det_res_filteredboxrKr-widthsheightsoverlap_matrixr>dropped_indexesij overlap_ratiopoly_overlap_ratiolabelsidxs rfilter_overlap_boxesrmls'~6.w7 7w<;;V7   +0(&& XXE:ES<(E:"** MF AqD\F1a4L (FQTlVAqD\)G;FCNeO 3u:  9q=GJN    "q1uc%j)A#q';*a40M!%558G$(88 3&x(,<<'++A.x(,<<'++A.s"$.3Cux3O)H!12EH=M4NPW*&*C/ (7+UXg->???CKRSOf,;1 !8ux'#''*#''*C*L&e,(,S?0J,(G$ #"k ;V(s H<H< I I-Icp[U[R5(aU$[R"U5$)z Convert the input to a PIL Image. Args: img (PIL.Image or numpy.ndarray): Input image. Returns: PIL.Image: PIL Image object. ) isinstancer fromarrayimgs r to_pil_imagerss)#u{{## ??3 rcp[U[R5(a[R"U5$U$)z Convert the input to a numpy array. Args: img (PIL.Image or numpy.ndarray): Input image. Returns: numpy.ndarray: Numpy array image. )ror r4rZrqs r to_np_arrayrus(#u{{##xx} JrcUVs/sHn[U5RPM nnUVs/sHn[U5RPM nn[U5n[ U5nXE4$s snfs snf)z Calculate width (max of all) and height (sum) for a vertical merge of images. Args: images (List[PIL.Image or np.ndarray]): List of images. Returns: Tuple[int, int]: (width, height) of merged image. )rswidthheightr&sum)imagesrrrcrdwhs rcalc_merged_whr}sc28 8#l3%%F 839:6C|C ''6G: F A G A 4K 9:s A$A)cTU(dg[U5S:Xa[US5$[U[5(aU/[U5S- -n[U5[U5S- :wa [ S5eUVs/sHn[ U5PM nnS/[U5-nUSR n[S[U55HonXGR n[Xh5n XS- n U S:XaX- S-n X- S-n OU S:Xa X- n X- n OSn Sn [U5Hn X]==U - ss'M XU'U nMq [SU55n[R"S Xn4S 5nSn[U5H*upsURX5UU45 UUR- nM, [U5$s snf) a Merge images vertically with given alignment. Args: images (List[PIL.Image or np.ndarray]): List of images to merge. aligns (str or List[str]): Alignment(s) for each merge step ('center', 'right', 'left'). Returns: np.ndarray: Merged image as numpy array. Nr/rz,The length of aligns must be len(images) - 1centerrrightc38# UHoRv M g7fN)rx).0rrs r merge_images..s3 ** RGBrr)r^rurostrr'rsrwr]r&ryr newr`pasterx)rzalignsrIrr pil_images x_offsetsmerged_wrgimg2_wstep_walignr:r<ktotal_hcanvasy_offsets r merge_imagesrs  6{a6!9%%&#S[1_- 6{c&kAo%GHH066v,s#vJ6c*o%I!}""H 1c*o &$$X&1u  H #)B/a'B g "BBBBqA LB L! '',3 33G YYux1? CFHJ' SQ<23CJJ( v I7s7F%cx ^^)^*/n0n[U5H&upVUST;aXdU'MURXV45 M( /n/n/n /n Sm)U)4Sjn U4Sjn [U5GHun upVU(d U/nU/n /n MX=S- upUSnUSnUSnUSn[UUS5nUS:H=(ai US :H=(a] UU:H=(aQ USUS :=(a? USUS :=(a- USUS - [US US- US US- 5S -:nUS:=(a US ;=(a UU:H=(a~ US US:=(al [ USUS - 5[US US- US US- 5S-:=(a/ T)"USUS5T)"US US 5- =(a U "X^U5nU(aSnOU(a U "UU5nOSnU(dU(a6URU5 U RU5 U RU5 GMURX45 U/nU/n /n GM U(aURX45 /nUH1unn[ U5[U5nnURUUUU45 M3 /n[ 5m*SnU[U5:Ga SnUGHunnnnUU:XdM[U*4SjU55(dM-SnUV s/sH oU SPM nn U(aUO/n [U5un!n"U!S:waU"U!- O [S5n#U#S :a[[U5HKun$n%UU%R5nUU%SUS'SUS'URU5 T*RU%5 MM Oy[UU U5n&[U5H]un$n%UU%R5nU$S:XaU&OSUS'U$S:XaU OSUS'USUS'URU5 T*RU%5 M_ /n'[US-U5Hn(U(U;dM U'RU(5 M U'H(n(URUU(5 T*RU(5 M* US-n O U(aGMXT;a*UT*;a$URXE5 T*RU5 US- nU[U5:aGM U$s sn f)a/ Merge blocks based on alignment and overlap logic, except for those with labels in non_merge_labels. Args: blocks (List[Dict]): List of block dicts. non_merge_labels (List[str]): Block labels that should not be merged. Returns: List[Dict]: List of processed (and possibly merged) blocks. rLc"[X- 5S:*$)Nr5)a1a2s r is_aligned merge_blocks..is_aligned4s27|q  rcZ>T"USUS5(agT"USUS5(agg)Nrleftrrr) block_bbox prev_bboxrs r get_alignment#merge_blocks..get_alignment7s6 jmYq\ 2 2  1 y| 4 4rc2>X!SnX Sn[USUS5n[USUS5n[USUS5n[USUS5nXVXx/n [U5H-upXU4;d U ST ;aMU Sn [X5S:dM- g g) Nrbrr/rr0rLTF)r%r&r`r) block_idxprev_idxblocksrrr:r;r<r=min_boxrl other_block other_bboxnon_merge_labelss roverlapwith_other_box+merge_blocks..overlapwith_other_box?s$U+ &u- 1z!} - 1z!} - 1z!} - 1z!} -2" )& 1 C8,,w'/??$U+J&w;a?!2rr/rb horizontalrtextrr0g333333?)rrSrNFc3,># UH oT;v M g7frr)rrg used_indicess rrmerge_blocks..s#Q=a\$9=sTrrinf merge_alignsgroup_id)r`appendrr&r5r%r\r^allr}floatcopyr_rr])+rrrIblocks_to_mergenon_merge_blocksrlblock merged_groups current_groupcurrent_indicescurrent_alignsrrrgr prev_blockr prev_labelr block_labeliou_his_crossis_updown_align align_mode group_ranges group_indicesrstartend result_blocks group_foundimgsrr{r| aspect_ratiorhr merged_img insert_listn_idxrrs+ ` @@r merge_blocksrsfO'  >- -$)S !  " "C< 0 ( MMON!&%_5?L!. v']);sUC?@"/M5L C F  1= -E3 ve|#Q=#Q Q Q" 2?@-Qq %(-@)/vR %d+1()Qq1uE%L 1$(1-(@ 9 &y 1 6 6 8'-i'8'?e 04n-%,,U3$((3 )A".dLBS!TJ(1-(@ 9 &y 1 6 6 856!Vze @AQ Dn-,9!,<j)%,,U3$((3 )A! "519c2E 00#**513)E!(()9%)@A $$U+)Ag?2>@    "s,'>  !1!6 7   S ! qO F P GAs!R7c ^SSKmSU4SjjnUVs/sHn[U5PM snupVpxXu- n X- n TRXU4Xx4SSS9 TRn Sn U"X+[ X5SS 9upn[ S [ R"X-55nXYU- S --nXjU-S --nTRUUUU4U U S UTRS 9 U$s snf)a~ Fill a rectangular area in the image with a white background and write the given token string. Paints directly on the provided image (in-place). Args: image (np.ndarray): Image to paint on (modified in-place). box (tuple): (x1, y1, x2, y2) coordinates of rectangle. token_str (str): Token string to write. Returns: np.ndarray: The same image (modified in-place). rN?c>SupEUnXT- S:a>XE-S- nT RXUSS9uupn XU-:a XU-:aUnUnOUnXT- S:aM>UWW 4$)N)g? g{Gz?rr/) thickness) getTextSize) rfontFace square_size fill_ratiorr optimal_scalemidr{r|_cv2s rget_optimal_font_scale+paint_token..get_optimal_font_scales  lT!<1$CqIIFQA++*4L0L # lT!a""rr)colorr)rr/r)rrr)lineType)r) rint rectangleFONT_HERSHEY_SIMPLEXr%r&mathfloorputTextLINE_AA)rXrb token_strrvr:r;r<r=box_wbox_hfontthickness_scale_ratio font_scaletext_wtext_hfont_thicknesstext_xtext_yrs @r paint_tokenrs# '**cc!fc*NBB GE GEMM%bB8?bMQ  # #D!7U*s"JDJJz'IJKN6>a' 'F 6>a' 'FKK     L9+sCcJSnSSKnURS5 0nUupgp/n U"[U55n URU 5 UR 5n[ U5HupU SupnnX:dMX:dMUU::dM$UU ::dM,U R U 5 [UU- UU- 5S:aMUX- X- UU- UU- /nS[X5-S-n[UUU5nU S UU'M [ U5VVs/sHunnUU ;dMUS PM nnnXU4$s snnf) a Replace figures in a table area with tokens, return new image and token map. Args: table_block_img (np.ndarray): Table image. table_box (list): Table bounding box [x_min, y_min, x_max, y_max]. figures (List[Dict]): List of figure dicts (must contain 'coordinate', 'path'). Returns: Tuple[np.ndarray, Dict[str, str], List[str]]: - New table image, - Token-to-img HTML map, - List of figure paths dropped. c1Skn/nSn[U5U:aC[[U55U-(dURU5 US- n[U5U:aMCU$)N>019rr/)r^r\rr)numexclude_digitsseqrgs rgen_random_map0tokenize_figure_of_table..gen_random_map sT( #hnAK.0 1 FA#hn rrNirN[F]path) randomseedr^shufflerr`rr%rr)table_block_img table_boxfiguresrr  token_map table_x_min table_y_min table_x_max table_y_max drop_idxes random_map figure_idfigure figure_x_min figure_y_min figure_x_max figure_y_maxdraw_boxrrgf drop_figuress rtokenize_figure_of_tabler#sS  KKI9B6KkJG -J NN:%**,O&w/ AG AU> L,  '+ + +   i (<,. |0KLrQ**{*{* H s:#899C?I)/8YOO#)&>Ii +0,+4G*<P*<$!QZIAfI* D DcF^^UU4SjnSn[R"XCU5$)z Replace tokens in a string with their HTML image equivalents. Args: table_res_str (str): Table string with tokens. figure_token_map (dict): Mapping from tokens to HTML img tags. Returns: str: Untokenized string. c>URS5nSUS3nTRX RS55nT RUS5nUcURS5$/nURSRUR SS5R SS 555 SR U5nUR S:waUR nUS U-S -- nU$) Nr/r r rzImagez-    )groupgetrformatreplacejoincontent) matchtoken_idtokenimg_path img_blockimg_tags image_info ocr_contentfigure_token_mapimage_path_to_obj_maps rrepl(untokenize_figure_of_table..replDs;;q>XJa #''{{1~>)--h=  ;;q> !H OO/66$$UB/77cB  8,J  B&'// f{2V;;  rz \[F(\d+)\])resub) table_res_strr8r9r:patterns `` runtokenize_figure_of_tabler@8s (G 66' //rc\rSrSr%SrSr\\S'Sr\\S'\\S'\\S'\\S'\\S '\ \S 'S r \ \S 'S r \ \S 'S r \ \S'\"SS9\S\S\4Sj55rSrg) TableCelli\aK TableCell represents a single cell in a table. Attributes: row_span (int): Number of rows spanned. col_span (int): Number of columns spanned. start_row_offset_idx (int): Start row index. end_row_offset_idx (int): End row index (exclusive). start_col_offset_idx (int): Start column index. end_col_offset_idx (int): End column index (exclusive). text (str): Cell text content. column_header (bool): Whether this cell is a column header. row_header (bool): Whether this cell is a row header. row_section (bool): Whether this cell is a row section. r/row_spancol_spanstart_row_offset_idxend_row_offset_idxstart_col_offset_idxend_col_offset_idxrF column_header row_header row_sectionbefore)rdatarc [U[5(amSU;aU$USRSS5n[U5(d<UR SS5nU(aUH nX$SS-- nM UR 5nX!S'U$)z Create TableCell from dict, extracting 'text' property correctly. Args: data (Any): Input data. Returns: Any: TableCell-compatible dict. rbboxr2r&text_cell_bboxesNr()rorr+r^popstrip)clsrMr text_cellsels rfrom_dict_formatTableCell.from_dict_formatxs dD ! !~ <##GR0Dt99!XX&8$? (7 c 11)zz|L rrN)__name__ __module__ __qualname____firstlineno____doc__rCr__annotations__rDrrIboolrJrKr classmethodrrV__static_attributes__rrrrBrB\s HcHc IM4JK(#CC$rrBcx\rSrSr%Sr/r\\\S'Sr \ \S'Sr \ \S'\ \ S\\\4Sj55rS rg ) TableDataiz TableData holds a table's cells, row and column counts, and provides a grid property. Attributes: table_cells (List[TableCell]): List of table cells. num_rows (int): Number of rows. num_cols (int): Number of columns. table_cellsrnum_rowsnum_colsrcD[UR5VVs/sH:n[UR5Vs/sHn[SUUS-UUS-S9PM snPM< nnnURHn[[ UR UR5[ URUR55HYn[[ URUR5[ URUR55H nXCUU'M M[ M U$s snfs snnf)zn Returns a 2D grid of TableCell objects for the table. Returns: List[List[TableCell]]: Table as 2D grid. r&r/)rrErFrGrH) r]rdrerBrcr%rErFrGrH)selfrgrh table_datacells rgridTableData.grids(4==)  *t}}- .A)*'(1u)*'(1u . *   $$DD--t}}=D++T]];114==A//?A(,qM!$  %-   sDD DDrN)rXrYrZr[r\rcrrBr]rdrrer propertyrjr`rrrrbrbsU$&Ki%HcHc d4 ?+rrbzzzzzzz+(?:|||||)z.*?(?=z|$))flagssc $SSR[[[[[ [ /5-S-n[R"X5n[R"X5nUVs/sHoDR5(dMUPM nnX#4$s snf)z Extract OTSL tags and text parts from the input string. Args: s (str): OTSL string. Returns: Tuple[List[str], List[str]]: (tokens, text_parts) (|)) r.OTSL_NL OTSL_FCEL OTSL_ECEL OTSL_LCEL OTSL_UCEL OTSL_XCELr<findallsplitrR)rnr?tokens text_partsr2s rotsl_extract_tokens_and_textr}sz ))WiIy)T U V   ZZ #F'%J%/AZE;;=%ZJA  Bs &B B c ^[m[R"UU4Sj5VVs/sHup#U(aM[U5PM nnn/nSnSnU(Ga%[ SU55nUH:n [ U 5U:dMU R [5 [ U 5U:aM&M< /n Sn UHn U Hn U R U 5 U [ U5:dM%X U :XdM/U S- n U [ U5:dMEX [[[[[[4;dMmU R X 5 U S- n M U R [5 U [ U5:dMX [:XdMU S- n M U nSn Sn[U5GH=unnSnU[[4;aSnSnSnU[:wa XS-nSnUU-[ U5:aXU-OSnSnUS-[ U5:aU[ XFS-5:a XFS-UnU[[4;aUU "XGS-U[[/5- nU[[4;aUU"XGUS-[[/5- nUR [UR5UUUUU-UUU-S 95 U[[[[[4;aUS- nU[:XdGM6US- nSnGM@ XT4$s snnf) z Parse OTSL text and tags into TableCell objects and tag structure. Args: texts (List[str]): List of tokens and text. tokens (List[str]): List of OTSL tags. Returns: Tuple[List[TableCell], List[List[str]]]: (table_cells, split_row_tokens) c>UT:H$rr)z split_words r"otsl_parse_texts..s Zrrc38# UHn[U5v M g7frr^rrows rr#otsl_parse_texts..s<+;Cs3xx+;rr/cxSnUnXUU;a*US- nUS- nU[X5:aU$XUU;aM*U$Nrr/r)r{c_idxr_idx which_tokensspan c_idx_iters r count_right%otsl_parse_texts..count_rightsY mJ'<7 !OJ AIDS// mJ'<7  rctSnUnXUU;a(US- nUS- nU[U5:aU$XUU;aM(U$rr)r{rrrr r_idx_iters r count_down$otsl_parse_texts..count_down!sX  '<7 !OJ AIDS[(  '<7  rr&r)rrCrDrErFrGrH)rs itertoolsgroupbylistr&r^rrurtrvrwrxr`rBrR)textsr{xysplit_row_tokensrcrrmax_colsr new_textstext_idxr2rrrgr cell_textrCrD right_offsetnext_right_cellnext_bottom_cellrs @rotsl_parse_textsrsJ%%f.GHHDA QH K E E<+;<<#Cc(X% 9%c(X%$ #C  'c%j(U_-EMH#e*,!!!!! I2"((9 A    W %#e*$G)CA #$$U#4 Iy) )HHLy !a%L  ,-|+;c%j+H,&'b  " qy3/003/ :;;'7 'B5'I$9i"88K$aiI8N Iy#99J$UQYI8N   "*%%).',x'7).',x'7  Iy)Y J J QJE 7? QJEEU$V  ((Is KKrhc VURnURn[UR5S:XagSnURn[ U5HnUS- n[ U5HnXEUnUR URpURURpX:wdX:waMD[R"URR55n UR(aSOSn U nUS:a USUS3- nU S:a US U S3- nUS US U S U S 3- nM US - nM SUS3nU$)zv Export TableData to HTML table. Args: table_data (TableData): TableData object. Returns: str: HTML string. rr&zthtdr/z rowspan=""z colspan="<>zzz
)rdrer^rcrjr]rCrErDrGhtmlescaperrRrI)rhnrowsncolsbodyrjrgrhrirowspanrowstartcolspancolstartr/celltag opening_tags rexport_to_htmlrYs>   E   E : ! !"a' D ??D 5\ uA"gajD!%0I0IX!%0I0IX} kk$))//"34G"00ddG$IK{G9A66 {G9A66 a }AgYb ; ;D !"TF( #D Krotsl_strc^[U[5(deUR5n[U;a U[-$UR [5n/nUHnU(dM [ R U5nU(dM*[U5nSn[U5H&upxUR[5(dM!US-nM( URXEUS.5 M U(d[$U(a[SU55OSn U(a[SU55OSn U n [X5n [S5n U n[XS-5H#m[U4SjU55nX:dMUn TnM% /nUHQnUSn[U5nUU:aUS UnO[ /UU- -nUU-nURS R#U55 MS [R#U5[-$) z Pad OTSL string to a square (rectangular) format, ensuring each row has equal number of cells. Args: otsl_str (str): OTSL string. Returns: str: Padded OTSL string. rr/) raw_cells total_lenmin_lenc3*# UH oSv M g7f)rNrrs rr%otsl_pad_to_sqr_v2..s>Xcy>Xc3*# UH oSv M g7frNrrs rrrs=HSK(Hrrc3F># UHn[UST- 5v M g7frr)rrrws rrrs# S(3S%5%=!>!>(s!rNr&)rorrRrsrzOTSL_FIND_PATTERNryr^r` startswithrtrr&rr]ryrur.)rlinesrow_datalinerrrrgcell_strglobal_min_width max_total_len search_start search_endmin_total_cost optimal_widthcurrent_total_costrepaired_linesrcells current_len new_cellspaddingrws @rotsl_pad_to_sqr_v2r~s h $ $$ $~~Hh'!! NN7 #EH %--d3   N $Y/KA""9--a%0 # P  BJs>X>>PQAIC=H==qM#L%5J5\NM|!^4 S( SS  ./N!M 5 NK %j  &n}-I k][%@AGIbggi01 << '' 11r otsl_contentc[U5n[U5up[X!5up4[[ U5U(a[ SU55OSUS9n[ U5$)z Convert OTSL-v1.0 string to HTML. Only 6 tags allowed: , , , , , . Args: otsl_content (str): OTSL string. Returns: str: HTML table. c38# UHn[U5v M g7frrrs rr'convert_otsl_to_html..s;*:3c#hh*:rr)rdrerc)rr}rrbr^r&r)rr{ mixed_textsrcrrhs rconvert_otsl_to_htmlrs_&l3L6|DF$4[$I!K%&?O#;*:;;UVJ * %%rc[U5n[SUS-S-5H!nX-S:XdM USUnX1U--U:XdMUs $ g)z Find the shortest substring that repeats to form the entire string. Args: s (str): Input string. Returns: str or None: Shortest repeating substring, or None if not found. r/rrN)r^r])rnnrg substrings r!find_shortest_repeating_substringrsT AA 1a1fqj ! 5A:"1IF#q(  " rr min_repeatsc0[[U5U-US- S5HvnX*SnURXB-5(dM"SnUnURU5(a#USU*nUS- nURU5(aM#[U5XS-- nUSUXE4s $ g)a Detect if string ends with a repeating phrase. Args: s (str): Input string. min_len (int): Minimum length of unit. min_repeats (int): Minimum repeat count. Returns: Tuple[str, str, int] or None: (prefix, unit, count) if found, else None. r/rNr)r]r^endswith)rnrrrgunitcounttemp_s start_indexs rfind_repeating_suffixrs3q6k*GaK <v ::d( ) )EF//$''! //$''a&EI.K\k?D/ /= rr/line_thresholdchar_threshold min_countc[U5U:aU$UR5nU(dU$SU;aF[U5S:a7[USSS9nU(a%Uupxn [U5U -[U5S-:aU$SU;a?[U5U:a0[U5nU(a[U5[U5-n X:aU$UR S5V s/sH)oR5(dMU R5PM+ n n U (dU$[U 5n X:aU$[ U 5n U R S5SupX:a X- S :aU$U$s sn f) as Detect and truncate character-level, phrase-level, or line-level repetition in content. Args: content (str): Input text. line_threshold (int): Min lines for line-level truncation. char_threshold (int): Min repeats for char-level truncation. min_len (int): Min length for char-level check. Returns: Union[str, str]: (truncated_content, info_string) r'dr)rrrSr/rg?)r^rRrrrzr most_common)r/rrrrstripped_content suffix_matchprefixrepeating_unitrrr total_lines line_countsmost_common_lines rtruncate_repetitive_contentrsU& 7|i}}  ##,<(=(C,-=qVWX ,8 )FE>"U*S1A-BS-HH  ##,<(=(G:;KL ()S-@@E&%%'.mmD&9 J&9dZZ\\TZZ\&9E J e*K#%.K)55a8; E$7C#? N Ks E+EcSSKn[UR5S:XaURXR5nOUR 5nUR [R:waUR[R5n[UR55n[UR55nX4:XaU$[R"S[RS9n[XCS-5Hn[Xd- X4- - S-5XV'M URX%5nUR!USSUR"5upUR%U 5n U cU$UR'U 5uppX X-2XU -24nU$)Nrr0rOr/r)rr^shapecvtColorCOLOR_BGR2GRAYrrPr4uint8astyperr&r%zerosr]LUT thresholdTHRESH_BINARY_INV findNonZero boundingRect)rrrgraymax_valmin_vallutrrMrbinaryr-rrr{r|croppeds r crop_marginr 4s7 399~||C!3!34xxz zzRXX{{288$$((*oG$((*oG  ((3bhh 'C 7aK (akg&783>?) 774 D dCc.C.CDIA __V $F ~ !!&)JA!ae)QQY&'G Nrz#<\|TEXT_START\|>(.*?)<\|TEXT_END\|>z!<\|LOC_BEGIN\|>(.*?)<\|LOC_END\|>z<\|LOC_(\d+)\|>rXcURSSupUS:aQUS:aK[U5n[RRnUR US-US-4U5n[U5$U$![ a [RnNCf=f)z? Post-process the input image to extract location information. Nri)rrsr ResamplingLANCZOSAttributeErrorresizeru)rXr|r{pil_imgresample_filters rpre_process_for_spottingr]s ;;r?DA4xAHu% ,#..66O..!a%QA7## L  ,#mmO ,sA++BB input_strr{r|c <[U[5(de[RU5n[RU5n/n/n[ [ U5[ U55n[U5HnX8R5n [RXH5n [ U 5S:aM=[[[U SS55n [SSS5V s/sHoU XS-4PM n n U Vs/sHoSS- U-USS- U-4PM n nURU 5 URU 5 M U(aU(Gd$[[RU55nSnSnUS-[ U5:aXUS-nUVs/sHn[UR!S55PM n n[SSS5V s/sHoU XS-4PM n n U Vs/sHoSS- U-USS- U-4PM n nUUUSR#5nUR5n URU 5 URU 5 USR%5nUS- nUS-[ U5:aMS R'U5nXVS .nUU4$s sn fs snfs snfs sn fs snf) zD Post-process the input string to extract text and location blocks. rNrrr/g@@rr)) rec_polys rec_texts)ror ANNOT_TEXT_REry LOC_BLOCK_REr%r^r]rR LOC_ITEM_RErmaprr LOC_TOKEN_REfinditerr*rrr.)rr{r|r loc_blocksrrrrgtxt loc_itemsvalsrhptspmatcheslast_endr*m text_span result_str spotting_ress rpost_process_for_spottingr*ns i % %% %  ! !) ,E%%i0JII CJJ(A 1Xhnn'' 6 y>A  CYr]+,/4Q1~>~!Q!e%~>?BCs!!v !1Q4&=1#45sC I|,,Y78 !ec'l"A&E-23UC OUD338Aq>B>aGTa%[)>CBCFG3aaD6MA%qtf}q'893CG!(U1X^^-=>I//#C   S !   S !Ry}}H FA!ec'l"Y'J!*CL | ##5?C4BGsJ2J $J<JJ)r)rauto)r+)rr)rrri )Errrr< collectionsrrrtypingrrrrr numpyr4PILr pydanticr r r layout_parsing.utilsrrrrrrr,ndarrayrGrmrsrur}rrrr#r@rBrbrsrtrurvrwrxNON_CAPTURING_TAG_GROUPcompileDOTALLrr}rrrrrrrr Srrrrrr*rrrr7s  00?? #25c?##25c?##2 #2 #2L JJ 2::rzz !">B#d4j)B#>AB# #tDz/B#J   "9x]@;|;4|!0H3 3l. .d       GJJv&=%>cB")) C*p)f"y"J727272t&s&*sDy1A(23 +. 5c3  %&: 6 666 6  6  6r F A244H zz>E jj+, zz,- BJJ4T ?"2$2$2$"2$ 3S$Y  2$r