9i#SSKJr SSKJr SSKrSSKJrJr /SQrSSjr SS \S\\ \44S jjr SS \S\ 4S jjr SS \S\ 4S jjrSS \S\ 4S jjrSS \S\ 4SjjrSS \SS4SjjrSS \SS4Sjjrg)) OrderedDict)AnyN) _device_t_get_device_index) empty_cachemax_memory_allocatedmax_memory_reservedmemory_allocatedmemory_reserved memory_statsreset_accumulated_memory_statsreset_peak_memory_statsreturnc[RR5(dg[RR5 g)a Release all unoccupied cached memory currently held by the caching allocator so that those can be used in other application. .. note:: This function is a no-op if the memory allocator for the current :ref:`accelerator ` has not been initialized. N)torch_C#_accelerator_isAllocatorInitialized_accelerator_emptyCacheX/var/www/html/land-doc-ocr/venv/lib/python3.13/site-packages/torch/accelerator/memory.pyrrs* 88 7 7 9 9 HH$$&r device_indexc,^^[RR5(d [5$[ USS9n[RR U5n/mS[ S[SS4UU4SjjmT"SU5 TR5 [T5$) a Return a dictionary of accelerator device memory allocator statistics for a given device index. The return value of this function is a dictionary of statistics, each of which is a non-negative integer. Core statistics: - ``"allocated.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: number of allocation requests received by the memory allocator. - ``"allocated_bytes.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: amount of allocated memory. - ``"segment.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: number of reserved segments from device memory allocation. - ``"reserved_bytes.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: amount of reserved memory. - ``"active.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: number of active memory blocks. - ``"active_bytes.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: amount of active memory. - ``"inactive_split.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: number of inactive, non-releasable memory blocks. - ``"inactive_split_bytes.{all,large_pool,small_pool}.{current,peak,allocated,freed}"``: amount of inactive, non-releasable memory. For these core statistics, values are broken down as follows. Pool type: - ``all``: combined statistics across all memory pools. - ``large_pool``: statistics for the large allocation pool (as of June 2025, for size >= 1MB allocations). - ``small_pool``: statistics for the small allocation pool (as of June 2025, for size < 1MB allocations). Metric type: - ``current``: current value of this metric. - ``peak``: maximum value of this metric. - ``allocated``: historical total increase in this metric. - ``freed``: historical total decrease in this metric. In addition to the core statistics, we also provide some simple event counters: - ``"num_alloc_retries"``: number of failed device memory allocation calls that result in a cache flush and retry. - ``"num_ooms"``: number of out-of-memory errors thrown. - ``"num_sync_all_streams"``: number of ``synchronize_and_free_events`` calls. - ``"num_device_alloc"``: number of device memory allocation calls. - ``"num_device_free"``: number of device memory free calls. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. ToptionalprefixvaluerNc>[U[5(a2UR5Hup#U(aUSU3OUnT"XC5 M gTRX45 g)N.) isinstancedictitemsappend)rrkv nested_prefix flat_statsflattens rr)memory_stats..flattenasO eT " " 396(!A3q  )&   vo .r) rrrrr_accelerator_getDeviceStatsstrrsort)rstatsr(r)s @@rr r !st 88 7 7 9 9}$\DAL HH 0 0 >EJ//C/D// BOO z ""rc8[U5RSS5$)aReturn the current :ref:`accelerator` device memory occupied by tensors in bytes for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. zallocated_bytes.all.currentrr getrs rr r ns  % ) )*G KKrc8[U5RSS5$)aReturn the current :ref:`accelerator` maximum device memory occupied by tensors in bytes for a given device index. By default, this returns the peak allocated memory since the beginning of this program. :func:`~torch.accelerator.reset_peak_memory_stats` can be used to reset the starting point in tracking this metric. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. zallocated_bytes.all.peakrr1r3s rr r {s  % ) )*Da HHrc8[U5RSS5$)aReturn the current :ref:`accelerator` device memory managed by the caching allocator in bytes for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. zreserved_bytes.all.currentrr1r3s rr r s  % ) )*F JJrc8[U5RSS5$)aReturn the current :ref:`accelerator` maximum device memory managed by the caching allocator in bytes for a given device index. By default, this returns the peak cached memory since the beginning of this program. :func:`~torch.accelerator.reset_peak_memory_stats` can be used to reset the starting point in tracking this metric. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. zreserved_bytes.all.peakrr1r3s rr r s  % ) )*CQ GGrcT[USS9n[RRU5$)adReset the "accumulated" (historical) stats tracked by the current :ref:`accelerator` memory allocator for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. .. note:: This function is a no-op if the memory allocator for the current :ref:`accelerator ` has not been initialized. Tr)rrr"_accelerator_resetAccumulatedStatsr3s rrrs%%\DAL 88 6 6| DDrcT[USS9n[RRU5$)aPReset the "peak" stats tracked by the current :ref:`accelerator` memory allocator for a given device index. Args: device_index (:class:`torch.device`, str, int, optional): the index of the device to target. If not given, use :func:`torch.accelerator.current_device_index` by default. If a :class:`torch.device` or str is provided, its type must match the current :ref:`accelerator` device type. .. note:: This function is a no-op if the memory allocator for the current :ref:`accelerator ` has not been initialized. Tr)rrr_accelerator_resetPeakStatsr3s rrrs%%\DAL 88 / / ==r)rN)N) collectionsrtypingrr_utilsrr__all__rr-r intr r r r rrrrrr@s# 0  'J#yJ#{387LJ#Z L9 L3 LIyIsI" K) K# KHiHcH"EEE">)>$>r