Ti[SSKJr SSKJrJr SSKrSSKrSSSjjrSS Sjjr g) ) annotations)AnySequenceNc ^SSKJn SSKJm SSSS.0n U(aU R SSSS.05 U "UUUUUUS9n U(aX{lU(a\"U4S jS [ RR5n SS jn /nUHunnURU "UUU55 M! U "U 5X4$"U4S jS [ RR5nSSjn/nUHunnURU"UUU55 M! U"U 5X4$)z Returns a model. See `LlamaConfig `_. The parameters are chosen for a unit test configuration. r) LlamaConfig) LlamaModelbatchlength)rr )num_hidden_layers vocab_size hidden_sizeintermediate_sizemax_position_embeddingsnum_attention_headsc2>^\rSrSrUU4SjrSrSrU=r$).get_llama_model..LlamaModelWrapperMask4c<>[TU]5 T"U5UlgNsuper__init__modelselfconfigr __class__s i/var/www/html/ai-image-ml/venv/lib/python3.13/site-packages/onnxscript/tools/transformers_models/llama.pyr7get_llama_model..LlamaModelWrapperMask.__init__5s "'/ cBURXSS9nUR5$)NF)attention_mask use_cacherto_tuple)r input_idsr# model_outputs rforward6get_llama_model..LlamaModelWrapperMask.forward9s+#zz *  $,,..r!r__name__ __module__ __qualname____firstlineno__rr)__static_attributes__ __classcell__rrs@rLlamaModelWrapperMaskr4s 0 / /r!r4c [RRRX/U5n[R "[R "X[RS95nUR[R:XdeX44$)N)dtype) onnxscripttoolstransformers_models ids_tensortorchtrilonesfloat32r6)r seqr r' input_masks rgenerate_example_inputs_mask5get_llama_model..generate_example_inputs_mask?se"((<<GG jIEJJu$OPJ##u}}4 44( (r!c2>^\rSrSrUU4SjrSrSrU=r$)*get_llama_model..LlamaModelWrapperOc<>[TU]5 T"U5Ulgrrrs rr3get_llama_model..LlamaModelWrapper.__init__Ps G  #F+DJr!cBURUSS9nUR5$)NF)r$r%)rr'r(s rr)2get_llama_model..LlamaModelWrapper.forwardTs#::i5:AL((* *r!r+r,r3s@rLlamaModelWrapperrDOs , + +r!rJc^[RRRX/U5nU4$r)r7r8r9r:)r r?r r's rgenerate_example_inputs0get_llama_model..generate_example_inputsXs+$$88CCULR\] |r!)r intr?rNr rN) transformersr(transformers.models.llama.modeling_llamarupdate_attn_implementationr;nnModuleappend) input_dimsrr r rrrrR with_maskrdynamic_shapesrr4rAexample_args_collectionbsrJrLrs @rget_llama_modelr\s")CW23Nqg(";<= ++ 7/ F&:# /EHHOO / )#%DAq # * *+G1j+Y Z%V,.EUU+EHHOO+!1&&'>q!Z'PQ V $&= MMr!c US:Xa:[[RRR XPU5SUSSSSUUS9 nOUS:Xa:[[RRR XPU5SUSSSSUUS9 nOPUS;a:[[RRR XPU5SUS S S S UUS9 nO[ S U<S35e[ S0UD6$)az Returns a model Phi to test or benchmark. Args: warmup: Number of inputs to generate. repeat: Number of inputs to generate for repeat. config: small, medium or large num_hidden_layers: Number of hidden layers. implementation: eager or sdpa with_mask: One or two inputs. dynamic_shapes: dynamic shapes or not Returns: Model and list of inputs. small) rVrr r rrrrRrWmedium)largedefaultii}i+i zUnexpected configuration .)dictr7r8r9get_input_dims_for_llm ValueErrorr\)warmuprepeatrr implementationrXrW conf_dicts rget_llama_model_from_configrocs0!'';;RR/ $( !!/   8 !'';;RR/"$( !!/   ' '!'';;RR/#$( "!/  4VJa@AA  'Y ''r!) ))ra)) r_r r`r_r`raeagerT)rVzSequence[tuple[int, int]]rrNr rNr rNrrNrrNrrNrRstrrWboolreturn0tuple[Any, list[tuple[torch.Tensor, ...]], dict]) r^r ruFT)rkrNrlrNrrvr rNrmrvrXrwrWrwrxry) __future__rtypingrrr;$onnxscript.tools.transformers_modelsr7r\rorgr!rrs # +-F#' 'QN)QNQNQN QN  QN ! QNQNQNQN6QNj! E( E( E( E( E(  E(  E(E(6E(r!