9i&SSKrSSKJr SSKJrJrJrJrJr SSK r SSK r SSK J r SSKJr SSKJr SSKJr SSKJr SS KJrJr SS KJr \"5rS S /rSS jrSSjrg)N)Mapping)AnyDictListTupleUnion) AutoTokenizer)Models) OutputKeys) Preprocessor)ModeKeys)get_model_typeparse_label_mapping) get_loggerparse_text_and_label labels_to_idc(SupVn[U[5(aUnO[U[5(d[U[5(aB[ U5S:XaUupVnO[ U5S:XaU[ R :XaUupVOUupWO[U[5(alURU5nURU5nUb[U[5(aURU5nO UVs/sHoRU5PM nnXVU4$s snf)aParse the input and return the sentences and labels. When input type is tuple or list and its size is 2: If the pair param is False, data will be parsed as the first_sentence and the label, else it will be parsed as the first_sentence and the second_sentence. Args: data: The input data. mode: The mode of the preprocessor first_sequence: The key of the first sequence second_sequence: The key of the second sequence label: The key of the label Returns: The sentences and labels tuple. NNN) isinstancestrtuplelistlenr INFERENCErget) datamodefirst_sequencesecond_sequencelabeltext_atext_blabelslbs b/var/www/html/land-doc-ocr/venv/lib/python3.13/site-packages/modelscope/preprocessors/nlp/utils.pyrrs(.FF$ D% JtT$:$: t9>%) "FF Y!^x)))!%!% D' " ".)/* =Juc22XXe_F-23UrhhrlUF3 6 !!4s/DcSn[U[[45(ac[UVs/sH oC"U5PM sn5(a=Ub:UVs/sHnXB;aX$O U[ U5PM snU[ R 'gU"U5(a-Ub*X;aUUO U[ U5U[ R 'gUbX[ R 'ggs snfs snf![a#n[RSUSUS35 UeSnAff=f)aTurn the labels to id with the type int or float. If the original label's type is str or int, the label2id mapping will try to convert it to the final label. If the original label's type is float, or the label2id mapping does not exist, the original label will be returned. Args: label2id: An extra label2id mapping. If not provided, the label will not be translated to ids. labels: The input labels. output: The label id. Returns: The final labels. cP[U[5=(d [U[5$N)rrint)r"s r'label_can_be_mapped)labels_to_id..label_can_be_mappedPs%%?E3)??NzLabel z& cannot be found in the label mapping zt,which comes from the user input or the configuration files. Please consider matching your labels with this mapping.) rrrallrr LABELSKeyErrorloggererror)r%outputlabel2idr,r"es r'rr@s, @ fudm , ,^d5e^dUZ6I%6P^d5e1f1f($)#E$)#4(3u::NN#)F:$$ %! ( (X-A!-)1)3;CK3H :$$ %  (.:$$ % 6f)  VHB8*MF G H s?$CCC !C.C9C=C C D (DD rr*)oscollections.abcrtypingrrrrrjsonnumpynp transformersr modelscope.metainfor modelscope.outputsr modelscope.preprocessors.baser modelscope.utils.constantr modelscope.utils.hubrrmodelscope.utils.loggerrr2__all__rrr.r'rFsU #00 &&)6.D.  !> 2 )-)-# &"R$r.