9i %SSKrSSKrSSKJr SSKJrJrJrJrJ r J r J r SSK r SSK Js Jr SSKJr SSKJr SSKJr SSKJrJr SS KJr SS KJr SS KJrJ r J!r!J"r"J#r#J$r$ SS KJ%r%J&r&J'r'J(r(J)r) \"5r*S r+0r,\\-\\-\44\.S'S!S\-S\S\ \-S\ \/S\SSS4 Sjjr0S\\/S\ \/\\/4S\\/4Sjr1S"S\)S\-S\ \-\%\\-44Sjjr2"SS\5r3"S S5r4g)#N)deepcopy)AnyDictListLiteralOptionalTupleUnion) get_logger)Module) pad_sequence)PreTrainedTokenizerBaseStoppingCriteria)loss_scale_map)get_tools_prompt) load_batch load_image rescale_image fetch_one to_device decode_base64)HistoryPrompt StopWordsContextMessageszYou are a helpful assistant.TEMPLATE_MAPPING template_type tokenizerdefault_system max_lengthtruncation_strategydeletetruncation_leftreturnTemplatec \[Un[US5nUR"XX440UD6 U$)Ntemplate)rr init_template)rr r!r"r#kwargs template_infor*s g/var/www/html/land-doc-ocr/venv/lib/python3.13/site-packages/modelscope/preprocessors/templates/base.py get_templater/s8%]3M j12H 9j`Y_` O token_listsub_token_listc[U[5(aU/n/nSnURUSUS-5n[U5S:XdXX3[U5-:XaUR U5 MM![ a U$f=f)z,Find the index of a token in the token_list.rr) isinstanceintindexlenappend ValueError)r1r2residxs r._findallr='s.#&&() C C "">!#4cAg>C>"a'>RUVdReLe=f+f 3   J sAA,, A:9A:messages replace_tokenc0/n/n[U5HupVUR5nUSb USS;aURU5 M7U[R"X&S5- n[R "X!US5US'URU5 M X4$)Ncontentrole)toolsystem assistant) enumeratecopyr9refindallsub)r>r?pattern images_path new_messagesims r.replace_img_tagrP7sKL(# FFH Y< 1V90O#O    " 2::g|< >R  1.2DNNN __  !T^^_*< =cd C]tG\G\]#I)S))$%y>A%)A,*=*=*?Y@P*QU^*^ $r0)rWrTr rV) __name__ __module__ __qualname____firstlineno____doc__rrrYtorchTensorboolrc__static_attributes__r0r.rRrRGsF"9yim %,, SWr0rRc\rSrSrSr/SQr/SQrSrS/rSr Sr Sr SjS \ S \ S \ \ S \ S\ \S\ \ S\S\S\ \ S\SS\SSS 4Sjjr\S \ S\ 4Sj5r\S \ S\4Sj5r\S\S\ \ S\ \ 4Sj5rSkS\S\ \S\ \S\S S!\S"\SS 4S#jjrS$\S%\S\\\44S&jrS'\\\4SS 4S(jrS'\\\4SS 4S)jrSlS*jrS+r S,r!SmS'\\\4S-\S.\S\"\\\4\\\444S/jjr#S'\\\4S\"\\\4\\\444S0jr$SnS1\%\&S2\%\&S3\%\'S4\ \S5\ \S6\ \S7\ \S8\SS 4S9jjr(S1\%\&S3\%\'S\"\%\&\%\'44S:jr)\S1\%\&S3\%\'S\"\%\&\%\'44S;j5r*S<r+S=\S>S?\S'\\\4S\%\&4S@jr,S?\S'\\\4S\%\&4SAjr-S?\S'\\\4S\%\&4SBjr.\/SC\%\\\4SD\%\SE\SFSS 4SGj5r0S1\%\&S3\%\'S\"\%\&\%\'44SHjr1SoS1\%\&S3\ \%\'S\"\%\\%\\%\'\\\444SIjjr2\SJ\%\SK\%\SS 4SLj5r3SpSM\%\\\4S\S\S\"\\\4\\\444SNjjr4SO\S\\\44SPjr5SQ\\\4SR\\\4SS 4SSjr6\SqST\%\7RpSU\'S\SVS\7Rp4SWjj5r9SoSX\%\\\4SY\ \S\\\44SZjjr:\/S[\7RpS\\S\%\4S]j5r;\S[\%\S\\S\%\4S^j5r<\S_\S\4S`j5r=\/SpS6\Sa\Sb\S\4Scjj5r>SrS SS S Sd.S[\%\Sb\SQ\ \\\4Se\Sa\ \%\Sf\ \%\4 Sgjjjr?S6\S'\@S\4ShjrASirBg )sr(caA template class for all supported models. Args: prefix: Prefix tokens before the first turn's prompt prompt: A list of elements whose types are str and list of integers. The input query part of every turn. chat_sep: The chat separators between every turn. suffix: The end tokens after the chat finished. default_system: A default system instruction. system_prefix: The prefix if the `system` is not empty. auto_add_bos: By default, the bos_token is not added. The auto_add_bos option will determine whether to add it based on `tokenizer.encode('')`. tools_prompt: The tools prompt name tool_prompt: The tool prompt, usually useful when there is a tool role padding_side: The padding side infer_media_type: The media type supported by the multi-modals Examples: system You are a helpful assistant! Who are you? assistant:I am a robot Who are you? assistant:I am a robot # noqa ----------system------------ ---query---- --response- -----chatsep----- ---query--- --response- ----suffix----- ----------------------------system_prefix---------------------------- ---------------------------- prompt ------------------------------------- ---------------------------- prompt ------------------------------------- )