U
�AT^j- c @ s� d dl Z d dlmZ d dlZd dlZd dlZd dlZd dlZddlm Z m
Z
ddl m Z dgZ
ejdkr�d dlZG dd � d e�Zn,G d
d � d e�Zd d � Zd
d� Ze �ee� G dd� de�ZG dd� de�ZdS )� N)� defaultdict� )� reduction�assert_spawning)�util�
BufferWrapperZwin32c @ s0 e Zd ZdZe�� Zdd� Zdd� Zdd� Z dS ) �ArenazL
A shared memory area backed by anonymous memory (Windows).
c C sx || _ td�D ]B}dt�� t| j�f }tjd||d�}t�� dkrH qZ|� � qt
d��|| _ || _ | j | j f| _
d S )Nid z pym-%d-%s������Ztagnamer z Cannot find name for new mmap)�sizeZrange�os�getpidZnext�_rand�mmap�_winapiZ GetLastError�closeZFileExistsError�name�buffer�_state)�selfr
�ir Zbuf� r �,/usr/lib64/python3.8/multiprocessing/heap.py�__init__& s
�Arena.__init__c C s t | � | jS �N)r r )r r r r � __getstate__5 s zArena.__getstate__c C s, | \| _ | _| _tjd| j | jd�| _d S )Nr r )r
r r r r )r Zstater r r � __setstate__9 s zArena.__setstate__N)
�__name__�
__module__� __qualname__�__doc__�tempfileZ_RandomNameSequencer
r r r r r r r r s
r c @ s8 e Zd ZdZejdkr dgZng Zd
dd�Zdd� Zd S ) r zJ
A shared memory area backed by a temporary file (POSIX).
Zlinuxz/dev/shmr c C sx || _ || _|dkrbtjdt�� | �|�d�\| _}t�|� t� | tj
| jf� t� | j|� t � | j| j �| _
d S )Nr zpym-%d-)ZprefixZdir)r
�fdr! Zmkstempr r � _choose_dirZunlinkr �Finalizer Z ftruncater r )r r
r" r r r r r M s
�
r c C s6 | j D ]&}t�|�}|j|j |kr| S qt�� S r )�_dir_candidatesr ZstatvfsZf_bavailZf_frsizer Z get_temp_dir)r r
ZdZstr r r r# [ s
zArena._choose_dirN)r ) r r r r �sys�platformr% r r# r r r r r C s
c C s( | j dkrtd��t| jt�| j �ffS )Nr zDArena is unpicklable because forking was enabled when it was created)r" �
ValueError�
rebuild_arenar
r ZDupFd)Zar r r � reduce_arenad s
r* c C s t | |�� �S r )r Zdetach)r
Zdupfdr r r r) j s r) c @ sz e Zd ZdZdZdZejfdd�Ze dd� �Z
dd� Z d d
� Z d d � Z
d
d� Zdd� Zdd� Zdd� Zdd� Zdd� ZdS )�Heapi i @ c C sX t �� | _t�� | _|| _g | _i | _i | _ i | _
t t �| _
g | _g | _d| _d| _d S �Nr )r r �_lastpid� threadingZLock�_lock�_size�_lengths� _len_to_seq�_start_to_block�_stop_to_blockr Zset�_allocated_blocks�_arenas�_pending_free_blocks�
_n_mallocs�_n_frees)r r
r r r r { s
z
Heap.__init__c C s |d }| | | @ S )Nr r )ZnZ alignmentZmaskr r r �_roundup� s z
Heap._roundupc C sZ | � t| j|�tj�}| j| jk r0| jd9 _t�d|� t|�}| j �
|� |d|fS )Ni z"allocating a new mmap of length %dr ) r: �maxr0 r �PAGESIZE�_DOUBLE_ARENA_SIZE_UNTILr Zinfor r6 �append)r r
�length�arenar r r �
_new_arena� s zHeap._new_arenac C sz |j }|| jk rd S | j�|�}| j|df= | j||f= | j�|� | j| }|�|d|f� |sv| j|= | j �|� d S r, )
r
� _DISCARD_FREE_SPACE_LARGER_THANr5 �popr3 r4 r6 �remover2 r1 )r r@ r? �blocks�seqr r r �_discard_arena� s
zHeap._discard_arenac C s| t �| j|�}|t| j�kr&| �|�S | j| }| j| }|�� }|sV| j|= | j|= |\}}}| j||f= | j||f= |S r ) �bisectZ bisect_leftr1 ZlenrA r2 rC r3 r4 ) r r
r r? rF �blockr@ �start�stopr r r �_malloc� s
z Heap._mallocc C s� |\}}}z| j ||f }W n tk
r0 Y nX | �|�\}}z| j||f }W n tk
rf Y nX | �|�\}}|||f}|| }z| j| �|� W n. tk
r� |g| j|< t�| j|� Y nX || j||f< || j ||f< d S r ) r4 ZKeyError�_absorbr3 r2 r> rH Zinsortr1 ) r rI r@ rJ rK Z
prev_blockZ_Z
next_blockr? r r r �_add_free_block� s(
zHeap._add_free_blockc C s^ |\}}}| j ||f= | j||f= || }| j| }|�|� |sV| j|= | j�|� ||fS r )r3 r4 r2 rD r1 )r rI r@ rJ rK r? rF r r r rM � s
z Heap._absorbc C s4 |\}}}| j | }|�||f� |s0| �|� d S r )r5 rD rG )r rI r@ rJ rK rE r r r �_remove_allocated_block� s
z Heap._remove_allocated_blockc C sB z| j �� }W n tk
r& Y q>Y nX | �|� | �|� q d S r )r7 rC Z
IndexErrorrN rO �r rI r r r �_free_pending_blocks s
zHeap._free_pending_blocksc C s~ t �� | jkr$td�t �� | j���| j�d�s>| j�|� n<z.| j
d7 _
| � � | � |� | �
|� W 5 | j� � X d S )Nz$My pid ({0:n}) is not last pid {1:n}Fr )r r r- r( �formatr/ Zacquirer7 r> Zreleaser9 rQ rN rO rP r r r �free s
��
z Heap.freec
C s� |dk rt d�|���tj|kr.td�|���t�� | jkrD| �� | j �� | j
d7 _
| � � | � t
|d�| j�}| �|�\}}}|| }||k r�| �|||f� | j| �||f� |||fW 5 Q R � S Q R X d S )Nr �Size {0:n} out of range�Size {0:n} too larger )r( rR r& �maxsize�
OverflowErrorr r r- r r/ r8 rQ r: r; �
_alignmentrL rN r5 Zadd)r r
r@ rJ rK Z real_stopr r r �malloc( s
z Heap.mallocN)r r r rX rB r= r r< r Z staticmethodr: rA rG rL rN rM rO rQ rS rY r r r r r+ s s
r+ c @ s" e Zd Ze� Zdd� Zdd� ZdS )r c C s^ |dk rt d�|���tj|kr.td�|���tj�|�}||f| _t j
| tjj |fd� d S )Nr rT rU )Zargs) r( rR r& rV rW r �_heaprY r r r$ rS )r r
rI r r r r F s
zBufferWrapper.__init__c C s& | j \\}}}}t|j�||| � S r )r Z
memoryviewr )r r@ rJ rK r
r r r �create_memoryviewO s z BufferWrapper.create_memoryviewN)r r r r+ rZ r r[ r r r r r B s )rH Z collectionsr r r r& r! r. Zcontextr r Z r Z__all__r' r Zobjectr r* r) Zregisterr+ r r r r r Z<module>
s&
$! P