9i|6 %SrSSKrSSKrSSKJrJrJrJr SSKrSSKJ r J r SSK J r JrJr SSKJr SSKJr \\ \\4r\R.r\R0rS q/q\\\/S4\\4\S '\R<"5r\R@"5r!\"5r"\#"\RHS 5(a\RHRJr&O S \S \4Sjr&\#"\RHS5(a\RHRNr(O S \S \4Sjr(Sr)Sr*S \+4Sjr,S8Sjr-"SS\.5r/S \+4Sjr0S \+4Sjr1S9S \\S S4Sjjr2S \4Sjr3S \4Sjr4S9S \\S \4Sjjr5S9S \\S \4Sjjr6S:S\\S\S \S S4S!jjr7S \8\\44S"jr9S#\\\\\/S4S S4S$jr:S;S%\+4S&jjr;S9S \\S \\\44S'jjrS \S S4S+jr?S9S \\S \8\\44S,jjr@"S-S 5r "S.S/5rAS0rBS)\S1S \A4S2jrCS[RR5$r )torch_C_mtia_isInBadForkr"rrr&r&>s 88 % % ''rc [5(d[[S5(ag[ [5(a SSS5 g[ 5(a [ S5e[ 5(d [S5e[RR5 S[l [RS[R555 [H upU"5 M [)[S5 SqSSS5 g![ a1nS[#U5SSR%U53n['U5UeSnAff=f![)[S5 f=f!,(df  g=f) Nis_initializingzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia.dynamic_library` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!Tc36# UHo(dM Uv M g7fr r").0callss r _lazy_init..dsX0NuRWUU0Ns  z6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: )r'hasattr_tls_initialization_lockr&r _is_compiledAssertionErrorr)r* _mtia_initr-rextend_lazy_seed_tracker get_calls ExceptionstrjoinDeferredMtiaCallErrordelattrr%) queued_callorig_tracebackemsgs rr!r!BsH74):;;          I ~~ *   $X0B0L0L0NXX -/<+ <M0= D+ , Y  H!<PQTUVQWPXYCCE77>CZB[]04!; < D+ ,W  sNEB E ED%E)E D?,D::D??EEE E%c\rSrSrSrg)r@ur"N)__name__ __module__ __qualname____firstlineno____static_attributes__r"rrr@r@usrr@c>[RR5$)z*Return true if compiled with MTIA support.)r)r* _mtia_isBuiltr"rrr7r7ys 88 ! ! ##rc<[5(dg[5S:$)z'Return true if MTIA device is availableFr)r7 device_countr"rr is_availablerQ~s >> >A rc[RRU5 [RR 5sSSS5 $!,(df  g=f)z?Waits for all jobs in all streams on a MTIA device to complete.N)r)mtiarr*_mtia_deviceSynchronizers r synchronizerUs0   6 "xx//1 # " "s A Ac>[RR5$)z,Return the number of MTIA devices available.)r)r*_mtia_getDeviceCountr"rrrPrP 88 ( ( **rc>[RR5$)z0Return the index of a currently selected device.)r)r*%_accelerator_hooks_get_current_devicer"rrcurrent_devicer[s 88 9 9 ;;rcP[RR[USS95$)a;Return the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Toptional)r)r*_mtia_getCurrentStreamrrs rcurrent_streamr`! 88 * *+[RR5$)z4Return a dictionary of MTIA memory allocator history)r)r*_mtia_memorySnapshotr"rrsnapshotrmrXrobservercB[RRU5 g)z9Attach an out-of-memory observer to MTIA memory allocatorN)r)r*_mtia_attachOutOfMemoryObserver)rns rattach_out_of_memory_observerrqs HH,,X6rincluding_emulationcg)NTr")rrs ris_bf16_supportedrts rcP[RR[USS95$)aReturn capability of a given device as a tuple of (major version, minor version). Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Tr])r)r*_mtia_getDeviceCapabilityrrs rget_device_capabilityrw" 88 - -.?QU.V WWrc>[RR5$)zEmpty the MTIA device cache.)r)r*_mtia_emptyCacher"rr empty_cacher{s 88 $ $ &&rstreamcJUcg[RRU5 g)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)r)r*_mtia_setCurrentStreamr|s r set_streamrs~ HH##F+rcf[U5nUS:a [RRU5 gg)zSet the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. rN)rr)r*%_accelerator_hooks_set_current_devicers r set_devicers,v &F { 66v>rcP[RR[USS95$)zReturn a dictionary of MTIA device properties Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Tr])r)r*_mtia_getDevicePropertiesrrs rget_device_propertiesrrxrcB\rSrSrSrS\4SjrSrS\S\S\4SjrS r g ) rizContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. c0[USS9UlSUlg)NTr]r)ridxprev_idx)selfrs r__init__device.__init__s$Vd; rc`[RRUR5Ulgr )r)r*(_accelerator_hooks_maybe_exchange_devicerr)rs r __enter__device.__enter__sII$((S rtypevalue tracebackc`[RRUR5Ulg)NF)r)r*rrr)rrrrs r__exit__device.__exit__s88DDT]]Sr)rrN) rHrIrJrK__doc__rrrrrLr"rrrrs3sTSrcZ\rSrSr%Sr\S\S'S\S4SjrSrS\ S \ S \ 4S jr S r g ) StreamContextiaContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. torch.mtia.Stream cur_streamr|cSUlXl[SS5Ul[R R 5(dURcSUl[R R 5(dSO[RRS5Ul [R R 5(dSUl g[RRS5Ul g)NTr) rr|rrr)jit is_scriptingrSrdsrc_prev_streamdst_prev_stream)rr|s rrStreamContext.__init__*s $T40yy%%''xx ..00Dejj6O6OPT6U  ..00D 6;jj6O6OPT6U rcURnUbURS:Xag[RR S5UlUR R UR :waL[ UR 5 [RR UR 5UlSSS5 [RRU5 g!,(df  N.=fNr) r|rr)rSr`rrrr)rrs rrStreamContext.__enter__9s[[  R $zz88>    & &**;*; ; ))*',zz'@'@ARAR'S$+ j)+*s >/C C#rrrc0URnUbURS:XagURRUR:wa)[R R UR5 [R R UR5 gr)r|rrrr)rSrr)rrrrrs rrStreamContext.__exit__Hsj[[  R     & &**;*; ; JJ ! !$"6"6 7 d223r)rrrrr|N) rHrIrJrKrr__annotations__rrrrrLr"rrrrsF ,--  x(;<   * 4S 4 4 4rrcD[RRXU5 g)zset stream specified by the stream id, device index and device type Args: stream_id (int): stream id in stream pool device_index (int): device index in topo device_type (int): enum device type N)r)r*_mtia_setStream) stream_id device_index device_types r_set_stream_by_idrVs HHYkBrrc[U5$)aWrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rrs rr|r|as   rc[R"S[SS9 [R"S/[R US9$)zReturns the random number generator state as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.get_rng_state is not implemented in torch.mtia stacklevelr )dtyper)warningswarn UserWarningr)zerosuint8rs r get_rng_staterls4 MM8 ;;s%++f ==r new_statec8[R"S[SS9 g)aSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.set_rng_state is not implemented in torch.mtiarrN)rrr)rrs r set_rng_stater{s MM8r)*)r#rQr'rUrPr[r`rd memory_statsmax_memory_allocatedmemory_allocatedreset_peak_memory_statsrwrrjrmrqr{rrr|rrrrt)rNr )allpythonr)T)rS)Hr threadingrtypingrrrrr)r_devicer torch._utilsr r r torch.typesr _utilsrr>int _device_tEventStreamr%rlisttuplerlocalr5Lockr6r;r4r*rrrrr#r'boolr&r!r=r@r7rQrUrPr[r`rdrjdictrmrqrtrwr{rrrrrr|rrmemory__all__r"rrrsB11 +EE% '3# $     t (2t8 d3i '( ~~'%' 588+,,xx44HHH  588011"XX??HsHsH 2 ((0f I $d$ d2+2t2 +c+ << U8I. U& U U8I. U& UPQE c]E,/EILE E&+$sCx.+ 7S#s+T127 74X(9"5XsCxX' ,v , ?y ?T ?X(9"5Xc3hX(7474tC!8/0!]! >%S%,, 67 >V > @F$S#u||%;< " r