9i~xSSKrSSKrSSKrSSKJr SSKJrJrJrJ r J r SSK r SSK Jr SSKJr SSKJr SS KJr SS KJr SS KJr SS KJr SS KJr SSKJr SSKJ r SSK!J"r" SSK#J$r$ SSK%J&r&J'r' SSK(J)r)J*r*J+r+J,r,J-r-J.r.J/r/ /SQr0\Rb"SS\ 55r2\"S5"SS\55r3g)N)chain)AnyDictOptionalTupleUnion)Image)logging)pipeline_requires_extra)ImageBatchSampler) ReadImage) benchmark) HPIConfig)PaddlePredictorOption)(AutoParallelImageSimpleInferencePipeline) BasePipeline) CropByBoxes) gather_imgs)PaddleOCRVLBlockPaddleOCRVLResult)convert_otsl_to_html crop_marginfilter_overlap_boxes merge_blockstokenize_figure_of_tabletruncate_repetitive_contentuntokenize_figure_of_table)image header_image footer_imagesealc+^\rSrSrSrS(S\S\\S\\S\ S\\ \\\ 4\ 4S S4 U4S jjjr S rS)S \ \ S4S \ \ S4S\ \ S4S\ \ S4S\ \ S4S\ \ S4S\\\S \4SjjrS\S \ 4SjrS*SjrS+S\ \\\\R*\\R*4S \ \ S4S \ \ S4S\ \ S4S\ \ S4S\\ \\4S\\ S\\ \\\\4\4S\\S\\ S\\ \S4S\ \ S4S\\S\\S \\S!\\S"\\S#\\S\\ S\\\S \4*S$jjrS%\S \4S&jrS'rU=r$),_PaddleOCRVLPipeline1z_PaddleOCRVLPipeline PipelineNconfigdevice pp_optionuse_hpip hpi_configreturnc>[TU]X#XES9 URSS5UlUR(a:URS05RSSS05nUR U5UlURSS5UlUR (aURS 05RS S S 05nURS S5nUbUS:XdS5e0n URSS5=n bXS'URSS5=n bXS'URSS5=n bXS'URSS5=n bXS'UR"U40U D6UlURSS5Ul URS 05RSS S05nURU5Ul URSS5Ul [URSS5S9Ul [SS9Ul[!5UlURSS5UlURS S5UlURS!/S"Q5Ulg)#af Initializes the class with given configurations and options. Args: config (Dict): Configuration dictionary containing various settings. device (str, optional): Device to run the predictions on. Defaults to None. pp_option (PaddlePredictorOption, optional): PaddlePredictor options. Defaults to None. use_hpip (bool, optional): Whether to use the high-performance inference plugin (HPIP) by default. Defaults to False. hpi_config (Optional[Union[Dict[str, Any], HPIConfig]], optional): The default high-performance inference configuration dictionary. Defaults to None. )r*r+r,r-use_doc_preprocessorT SubPipelinesDocPreprocessorpipeline_config_errorz+config error for doc_preprocessor_pipeline!use_layout_detection SubModulesLayoutDetectionmodel_config_errorz"config error for layout_det_model! model_nameNzPP-DocLayoutV2z!model_name must be PP-DocLayoutV2 threshold layout_nmslayout_unclip_ratiolayout_merge_bboxes_modeuse_chart_recognition VLRecognitionzconfig error for vl_rec_model!format_block_contentF batch_sizer)r@BGR)format use_queuesmerge_layout_blocksmarkdown_ignore_labels)numberfootnoteheaderr#footerr$ aside_text)super__init__getr0create_pipelinedoc_preprocessor_pipeliner4 create_modellayout_det_modelr= vl_rec_modelr?r batch_samplerr img_readerr crop_by_boxesrCrDrE)selfr)r*r+r,r-doc_preprocessor_configlayout_det_configr8 layout_kwargsr9r:r;r< vl_rec_config __class__s q/var/www/html/land-doc-ocr/venv/lib/python3.13/site-packages/paddlex/inference/pipelines/paddleocr_vl/pipeline.pyrL_PaddleOCRVLPipeline.__init__5s*   %+JJ/Et$L!  $ $&,jj&D&H&H!+-Z' # .2-A-A'.D *%+JJ/Et$L!  $ $ & < < @ @!%'KL! +..|TBJ&:9I+I 32 3IM.22;EE R-6k*/33L$GG T.8l+'8'<'<)4(#  8K34,=,A,A.-(  =U89$($5$5!%%2%D !&,ZZ0G%N" <488  !#C D !--m<$*JJ/Eu$M!.&**\ST:UV#51(] **\59#)::.CT#J &,jj $  ' #c8URR5 gN)rRcloserVs r\ra_PaddleOCRVLPipeline.closes !r^use_doc_orientation_classifyuse_doc_unwarpingr4r=r?rDrEc UcUc URnOUSLdUSLaSnOSnUc URnUc URnUc URnUc URnUc UR n[ UUUUUUS9$)a Get the model settings based on the provided parameters or default values. Args: use_doc_orientation_classify (Union[bool, None]): Enables document orientation classification if True. Defaults to system setting if None. use_doc_unwarping (Union[bool, None]): Enables document unwarping if True. Defaults to system setting if None. Returns: dict: A dictionary containing the model settings. TF)r0r4r=r?rDrE)r0r4r=r?rDrEdict) rVrdrer4r=r?rDrEr0s r\get_model_settings'_PaddleOCRVLPipeline.get_model_settingss* ( /4E4M#'#<#< +t37HD7P'+$',$  '#'#<#< ($($>$> !  '#'#<#<  &"&":":  ! )%)%@%@ "!5!5"7!5 3#9   r^ input_paramschUS(a(UR(d[R"S5 gg)a Check if the input parameters are valid based on the initialized models. Args: input_params (Dict): A dictionary containing input parameters. Returns: bool: True if all required models are initialized according to input parameters, False otherwise. r0zRSet use_doc_preprocessor, but the models for doc preprocessor are not initialized.FT)r0r error)rVrjs r\check_model_settings_valid/_PaddleOCRVLPipeline.check_model_settings_valids, . /8Q8Q MMd r^c /n/n/n /n /n [5n U(a[O [S/-n [[XU55GH"ununnn[ U5nUSnUR UU5nU(a[ UU S/-S9nURU5 [U5HunnUSnUSnUU ;dMUcM0nSn/nUS:XaSn[UUS U5unnnO)US:Xa U(aS nOS U;aUS :wa S n[U5nURU5 U RU5 U RU5 U RUU45 U RU5 M GM% Uc0nOURSS5cSUS'SS0UEn[URR"[X5VVs/sH unnUUS.PM snn4SS0UD65n/n/nSn[U5GHunn/n /n![U5GHunnUSnUS n"USnSn#U[U 5:aU UUU4:XaUUn$U UnUUn%US- nU%U$S'U$RSS5n&U&cSn&[!U&5n&SU&;aSU&;d SU&;arSU&;alU&R#SS5n&U&R#SS5R#SS5R#SS5R#SS5n&US :XaU&R#SS5n&US:Xa[%U&5n'U'S:waU'n&['U&U5n&U&n#[)UU"U#URS S5S!9n(UU ;a{Ubx[[+[,U"55un)n*n+n,S"US#U)S$U*S$U+S$U,S%3 n-U-U ;a?SSKn.U.R1UU.R25nU-[4R6"U5S&.U(lOGMU RU(5 GM URU 5 URU!5 GM UUU4$s snnf)'Nchartboxestable)non_merge_labelsimglabelzOCR:zTable Recognition:boxzChart Recognition:formulaformula_numberzFormula Recognition:max_new_tokensi use_cacheT)r"queryskip_special_tokensrrr"resultz\(z\)z\[z\]$z $ z $$ group_id)rubboxcontentrz imgs/img_in__box__z.jpg)pathrt)set IMAGE_LABELS enumerateziprrUrappendrrupdaterMlistrRpredictlenr replacerr!rmapintcv2cvtColor COLOR_BGR2RGBr fromarrayr")/rVimageslayout_det_results imgs_in_docr= vlm_kwargsrDblocks block_imgs text_prompts vlm_block_idsfigure_token_mapsdrop_figures_set image_labelsir"layout_det_resimgs_in_doc_for_imgrqblocks_for_imgjblock block_img block_labelfigure_token_map text_prompt drop_figureskwargsvl_rec_resultsparsing_res_liststable_res_listscurr_vlm_block_idxparsing_res_listtable_res_list block_bbox block_content vl_rec_result block_img4vl result_strhtml_str block_infox_miny_minx_maxy_maximg_pathrs/ r\get_layout_parsing_results/_PaddleOCRVLPipeline.get_layout_parsing_resultss   51L|wi7O @I K 8@ ;A;~':2.AN"7+E!//u=N"!-"\WI5M" MM. )%n55!%L #Gn l2y7L')$"(K#%L"g-&: 4 )5<9LB #3\ %/4I&: "k1kEU6U&< $/ $: %%i0 '' 4%,,-=>!((!Q0$++L9/6@ H  J ^^,d 3 ;+/J' (       % % 36j2O  3P. ;"+!,3P  %)    !*6!2 A~! N%n55!%L "5\ #Gn " %M(::}&@V@%33E$FM'89K'L$#-.@#AL&!+&-9M'*!.!2!28R!@J!)%' !)1J%?&(8& %/M-%#)"YYz48  ,.93H15c#z6J1K.E5%!-k]%wawaPUwVWX]W^^bcH'77"$'LLC 2C"3F!/;>>es5O4inputlayout_thresholdr:r;r<rC prompt_labelrepetition_penalty temperaturetop_p min_pixels max_pixelsryc +^^^^^^^ ^ ^ ^^^^^^"^#^$^%^&^'^(^)^*^+# TRTTUUU UU5m(TRT(5(dSS0v U c TRn T(S(dCT (aT OSm T R5S:XaST(S'T R5S ;d S T S 35eS U UUUU(U UUU4 S jjm"UUUU(U UUU4S jm#U (Ga<Sn[R "US9m*[R "US9m)[R "TR RU-S9m+[R"5m&[R"5m%[R"5m$[R"5m'U%U&U*U4SjnU"U$U%U&U(U)U*U4SjnU#U$U&U'U)U+U4Sjn[R"UU4SS9nUR5 [R"USS9nUR5 [R"USS9nUR5 U (aT'R5(aT+R5(dfT+RSS9nUS(d[!SUSSUS35eUSv T'R5(dMOT+R5(dMfO`TR U5HKn[#T""U55n[%U5S:Xd[%U55eUSn T#"U 5Hn!U!v M MM U (aT&R'5 WR)SS9 UR+5(a[,R."S5 WR)SS9 UR+5(a[,R."S5 ggg![Ra T'R5(aMGMf=f!U (aT&R'5 WR)SS9 UR+5(a[,R."S5 WR)SS9 UR+5(a[,R."S5 fff=f7f)!a Predicts the layout parsing result for the given input. Args: input (Union[str, list[str], np.ndarray, list[np.ndarray]]): Input image path, list of image paths, numpy array of an image, or list of numpy arrays. use_doc_orientation_classify (Optional[bool]): Whether to use document orientation classification. use_doc_unwarping (Optional[bool]): Whether to use document unwarping. layout_threshold (Optional[float]): The threshold value to filter out low-confidence predictions. Default is None. layout_nms (bool, optional): Whether to use layout-aware NMS. Defaults to False. layout_unclip_ratio (Optional[Union[float, Tuple[float, float]]], optional): The ratio of unclipping the bounding box. Defaults to None. If it's a single number, then both width and height are used. If it's a tuple of two numbers, then they are used separately for width and height respectively. If it's None, then no unclipping will be performed. layout_merge_bboxes_mode (Optional[str], optional): The mode for merging bounding boxes. Defaults to None. use_queues (Optional[bool], optional): Whether to use queues. Defaults to None. prompt_label (Optional[Union[str, None]], optional): The label of the prompt in ['ocr', 'formula', 'table', 'chart']. Defaults to None. format_block_content (Optional[bool]): Whether to format the block content. Default is None. repetition_penalty (Optional[float]): The repetition penalty parameter used for VL model sampling. Default is None. temperature (Optional[float]): Temperature parameter used for VL model sampling. Default is None. top_p (Optional[float]): Top-p parameter used for VL model sampling. Default is None. min_pixels (Optional[int]): The minimum number of pixels allowed when the VL model preprocesses images. Default is None. max_pixels (Optional[int]): The maximum number of pixels allowed when the VL model preprocesses images. Default is None. max_new_tokens (Optional[int]): The maximum number of new tokens. Default is None. merge_layout_blocks (Optional[bool]): Whether to merge layout blocks. Default is None. markdown_ignore_labels (Optional[list[str]]): The list of ignored markdown labels. Default is None. **kwargs (Any): Additional settings to extend functionality. Returns: PaddleOCRVLResult: The predicted layout parsing result. rlz0the input params for model settings are invalid!Nr4ocrrpTr=)rrwrrrpzLayout detection is disabled (use_layout_detection=False). 'prompt_label' must be one of ['ocr', 'formula', 'table', 'chart'], but got 'z'.c3Z> # U(d [U5n[S[U5U5GHdnURX"U-nURX"U-nURX"U-nUR X"U-nTR U5nTS(a[TRUTTS95nOUV s/sHn SU 0PM nn UV s/sHoSPM n n TS(aH[TRU TTTTS95n [X5V Vs/sHup[XS5PM nn nOd/n U HJnU RSSSTR5SSSURSURS/S ./S .5 ML U Vs/sHn/PM nnXEXkXU4v GMg gs sn fs sn fs snn fs snf7f) Nrr0)rdre output_imgr4)r9r:r;r<rqr)cls_idruscore coordinate) input_path page_indexrq)rrange instances input_paths page_indexes page_countsrTrrOrQrrrlowershape) batch_datanew_batch_sizeidxrrrr image_arraysdoc_preprocessor_resultsarritemdoc_preprocessor_imagesr doc_pp_imgrrdoc_preprocessor_imagerr<r:rr;model_settingsrrVrdres r\ _process_cv1_PaddleOCRVLPipeline.predict.._process_cvs4!!$ZQJ@&00^7KL (44S;OP )66s>=QR (44S;OP #y9 !"89/366(9U.?70,8D07Cs+|-0 4L+3K4&3K(+""89)---3&6'10C5M .*&;>3;#;6J$Jw0GH; #K*,&2I.*11.2.2341=1C1C1E12,-,-,B,H,H,K,B,H,H,K 7* %& *"3J(0B"B/A!2/AK"B!WoFQQQEA"0+#8#Cs7B+F+.F<F+F6F+F  AF+: F&%F+c 3 ># UunnnnnnnTRUUUTSTTTTTTS.TS5upn[UUUUUUU UU5 HBu n n n n nnnnnU U U U RSU RSUUUUUTS. n[U5v MD g7f)Nr=)rrrrrryrDrr) rr page_countwidthheightdoc_preprocessor_resrrrrr)rrrr) results_cvrrrrrrrrrrrrrrrrrrsingle_img_resryrrrrrVrrs r\ _process_vlm2_PaddleOCRVLPipeline.predict.._process_vlms  '("//+&"#:;.@'2!&&0&0*8 ##89 <  8'("!  &$ ##-",",399!<4::1=,@&4&4(8#6&4 "(771 sB B@)maxsizecN>TRU5nTR5(d6[U5nTRSU45 TR5(dM6TR 5 g![a M[ anTRSSU45 SnAMASnAff=f)NTFr)rSis_setnextput StopIteration Exceptionr)input_all_batch_datareevent_data_loading_doneevent_shutdown queue_inputrVs r\ _worker_input3_PaddleOCRVLPipeline.predict.._worker_input^s!%!3!3F!;(//11<%).%9 $z(:;)//11(++-)$#(;<s A// B$< B$BB$c4>TR5(dT RSS9nUS(dTR U5 gT"USTS(a T R RROS5HnTR SU45 M TR5(dMgg![Ra+ TR5(aTR 5 gMf=f![anTR SSU45 SnAgSnAff=f) N?timeoutrrr4TFcv) rrMqueueEmptyrrrQrSr@r) rrrrevent_cv_processing_donerrrqueue_cvrrVs r\ _worker_cv0_PaddleOCRVLPipeline.predict.._worker_cvls(//11!*s;  7 T* *5 G$22H#I!% 5 5 C C N N%) +J%LL$ );<+)//11!;;!299;;488:! !$% eT1%56s*B-AC/-9C,+C,/ D9DDc>SnTRRRnTR5(GdP/n[R"5nSnSnU[R"5U- - nUS::aOjTR US9nUS(dTRU5 SnO._worker_vlms'*$ $ 1 1 ? ? J J (//11&(O!%J#(L !I)= IIK*4**Q.!"#+<<<#GD $Aw%MM$/+/L!'..tAw7#22#6q#9C%S\)::I$:$5!%&$*3::<<599;! &)/%:)%:EU0078%:&) *67H*IJ%MM4*<=+JM)//11 %{{"!"&)%! ueQ&78s09F #)F&"F+ F#"F#+ G5GGF)targetargsdaemon)rr!rrrzException from the 'rz ' worker: rr z#CV worker did not terminate in timez$VLM worker did not terminate in timer`)rhrmrCrrQueuerSr@ threadingEventThreadstartremptyrMr RuntimeErrorrrrjoinis_aliver warning),rVrrdrer4r=rr:r;r<rCrr?rrrrrryrDrErmax_num_batches_in_processrrr thread_input thread_cv thread_vlmrrrrrrrrrrrrrrrs,` `` ```` ` `````` @@@@@@@@@@r\r_PaddleOCRVLPipeline.predictvsp00 (  !  " ..~>>NO O  J45+767%%', k Z[gZhhjk  kF QF QP? 8? 8B )+ &++.HIK{{+EFH **558RRI'__.N&/oo&7 #'0'8 $(1(9 % . .  4. . `%++$E8EL    !(( 5II OO "))UKJ     L4;;==)//BSBS!(}}S}9  7*247):d1gYO#1g 5;;==)//BSBS#'"4"4U";J&*;z+B&CO/14Jc/6JJ4!0!3J+J7!  8 #<""$q)%%''OO$IJ*&&((OO$JK) %!;;!4;;==! !$""$q)%%''OO$IJ*&&((OO$JK) sQG1Q 1O>N =O O#A!OBQ)O;OOOBQQ markdown_listc2SnUHnUSUS-- nM U$)z Concatenate Markdown content from multiple pages into a single document. Args: markdown_list (list): A list containing Markdown data for each page. Returns: tuple: A tuple containing the processed Markdown text. r}z markdown_texts)rVr1r3rs r\concatenate_markdown_pages/_PaddleOCRVLPipeline.concatenate_markdown_pagess0 C fs+;'<< 9#<=> _  _ _ B"7;3 &+D$J&73 !t,3 $D$J/ 3 %T4Z0 3 $D$J/ 3 #4:.3 !)c 33  3 jt0$ S?p;@/426379=%)QU26%)3726.2'+!%$($((,.26:+gLS$s)RZZbjj1AABgL',D$J&7gL!t, gL $D$J/ gL %T4Z0 gL#5#56gLTNgL&eE53F,L&MNgL#+3-gLTNgLuS$Y/0gL$D$J/gL%UOgLe_gL !gL"SM#gL$SM%gL&! 'gL(&d^)gL*!)c 3+gL. /gLR r^r'rc.\rSrSrSr\S5rSrSrg)PaddleOCRVLPipelineiz PaddleOCR-VLc[$r`)r'rbs r\ _pipeline_cls!PaddleOCRVLPipeline._pipeline_clss##r^c&URSS5$)Nr@r)rM)rVr)s r\_get_batch_size#PaddleOCRVLPipeline._get_batch_sizeszz,**r^r4N) r7r8r9r:entitiespropertyrGrJrBr4r^r\rErEsH $$+r^rE)4rr#r itertoolsrtypingrrrrrnumpyr>PILr utilsr utils.depsr common.batch_samplerr common.readerrutils.benchmarkr utils.hpirutils.pp_optionr _parallelrbaser componentsrlayout_parsing.utilsrr~rruiltsrrrrrr r!r time_methodsr'rEr4r^r\r_s  4425&("4@$.7A  | <| | ~+B+ +r^