Mini Shell
U
��eg� � , @ sz d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z d dl
Z
d dl Z d dl Z d dl
Z
d dlZd dlmZ d dlmZ z d dlZW n ek
r� dZY nX d dlmZ d dlmZmZmZmZm Z m Z m Z m Z m Z m!Z! d dlm"Z" z e!� � d dl#Z$W 5 Q R X W n ek
�r6 dZ$Y nX e
�%e j&dk d�Z'e(ej)d �Z*d
d � Z+d d
� Z,dd� Z-G dd� dej.�Z/G dd� de0�Z1G dd� d�Z2G dd� d�Z3G dd� de3�Z4G dd� de3�Z5G d d � d �Z6G d d � d �Z7d dl8Z8e3e8_3d e3_9e4e8_4d e4_9e5e8_5d e5_9G d!d"� d"e:�Z;G d#d$� d$e3�Z<G d%d&� d&e=�Z>G d'd(� d(e0e>d)�Z?G d*d+� d+e=�Z@d,d-� ZAG d.d/� d/eB�ZCG d0d1� d1eD�ZEedk �r�G d2d3� d3�ZFd4ZGd5ZHd6ZId7ZJd8ZKd9ZLd:ZMd;ZNd<ZOd=ZPd>ZQd?ZRd@ZSdAZTeUeVeWeXeYeZe[e\e]e^e_e`eaebeecedeeefegeheiejekelemeneoepeqereseteuevewexeyeze{e|e}e~ef,Z�dBZ�dCZ�dDdE� Z�G dFdG� dGe
j��Z�G dHdI� dIe
j��Z�G dJdK� dKe
j��Z�G dLdM� dMe0�Z�G dNdO� dOe0�Z�G dPdQ� dQe0�Z�G dRdS� dSe0�Z�G dTdU� dUe0�Z�G dVdW� dWe0�Z�G dXdY� dYe0�Z�G dZd[� d[e0�Z�G d\d]� d]e:�Z�G d^d_� d_e��Z�G d`da� dae��Z�G dbdc� dce��Z�G ddde� dee��Z�G dfdg� dge��Z�G dhdi� die��Z�G djdk� dke��Z�G dldm� dme��Z�G dndo� doe��Z�e�e�e�e�e�e�e�e�e�e�g
Z�G dpdq� dqe��Z�G drds� dse:�a�G dtdu� dut��Z�G dvdw� dwt��Z�G dxdy� dy�Z�G dzd{� d{e
j��Z�G d|d}� d}e
j��Z�G d~d� de
j��Z�G d�d�� d�e
j��Z�d�Z�G d�d�� d�e0�Z�G d�d�� d�e0�Z�d�d�� Z�G d�d�� d��Z�G d�d�� d�e
j��Z�G d�d�� d�e
j��Z�e�d k�rvd d�lm�Z� e�� Z�e(ej)d �D ]�Z�e��e�e��Z�e�d���e��� e(d e�e��d��D ](Z�eBe�e�e�d� � �Z�e�d���e��� �qe�d�� e�� e�d���e��� e�d���e��� e�e�� e�d�� e�� �q�dS )�� N)�dedent)� SimpleCookie)�support)
�
TestFailed�TESTFN�run_with_locale�
no_tracing�_2G�_4G�
bigmemtest� reap_threads�forget� save_restore_warnings_filters)� bytes_typesl z(test is only meaningful on 32-bit builds� c C s0 t �|�D ] \}}}|j| �d�kr
dS q
dS )N�latin-1TF�� pickletools�genops�code�decode)r �pickle�op�dummy� r �0/opt/cppython/lib/python3.8/test/pickletester.py�opcode_in_pickle5 s r c C s6 d}t �|�D ]"\}}}|j| �d�kr|d7 }q|S )Nr r r r )r r �nr r r r r � count_opcode< s
r c C s | S �Nr ��xr r r �identityD s r" c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd S )
� UnseekableIOc G s t �d S r )�NotImplementedError��self�argsr r r �peekI s zUnseekableIO.peekc C s dS )NFr �r& r r r �seekableL s zUnseekableIO.seekablec G s
t j�d S r ��io�UnsupportedOperationr% r r r �seekO s zUnseekableIO.seekc C s
t j�d S r r+ r) r r r �tellR s zUnseekableIO.tellN)�__name__�
__module__� __qualname__r( r* r. r/ r r r r r# H s r# c @ s e Zd ZdZdd� ZdS )� MinimalIOz=
A file-like object that doesn't support readinto().
c G s8 t j|� | _| jj| _| jj| _| jj| _| jj| _d S r )r, �BytesIOZ_bio�getvalue�read�readline�writer% r r r �__init__Z s
zMinimalIO.__init__N)r0 r1 r2 �__doc__r9 r r r r r3 V s r3 c @ s e Zd Zdd� Zdd� ZdS )�ExtensionSaverc C sB || _ |tjkr8tj| | _t�| jd | jd |� nd | _d S �Nr r )r �copyreg�_inverted_registry�pair�remove_extension)r& r r r r r9 o s
zExtensionSaver.__init__c C sX | j }tj�|�}|d k r0t�|d |d |� | j}|d k rTt�|d |d |� d S r< )r r= r> �getr@ r? �
add_extension)r& r Zcurpairr? r r r �restorex s zExtensionSaver.restoreN)r0 r1 r2 r9 rC r r r r r; l s r; c @ s e Zd Zdd� ZdS )�Cc C s | j |j kS r )�__dict__�r& �otherr r r �__eq__� s zC.__eq__N)r0 r1 r2 rH r r r r rD � s rD c @ s e Zd Zdd� ZdS )�Dc C s d S r r )r& �argr r r r9 � s z
D.__init__N�r0 r1 r2 r9 r r r r rI � s rI c @ s e Zd Zdd� ZdS )�Ec C s dS �Nr r r) r r r �__getinitargs__� s zE.__getinitargs__N)r0 r1 r2 rN r r r r rL � s rL c @ s e Zd ZdS )�ObjectN�r0 r1 r2 r r r r rO � s rO c @ s e Zd Zdd� Zdd� ZdS )�Kc C s
|| _ d S r )�value)r& rR r r r r9 � s z
K.__init__c C s t | jffS r )rQ rR r) r r r �
__reduce__� s z K.__reduce__N)r0 r1 r2 r9 rS r r r r rQ � s rQ �__main__c @ s e Zd Zdd� ZdS )�myintc C s t |�| _ d S r ��str)r& r! r r r r9 � s zmyint.__init__NrK r r r r rU � s rU c @ s e Zd Zdd� Zdd� ZdS )�initargc C s || _ || _d S r ��a�b)r& rZ r[ r r r r9 � s zinitarg.__init__c C s | j | jfS r rY r) r r r rN � s zinitarg.__getinitargs__N)r0 r1 r2 r9 rN r r r r rX � s rX c @ s e Zd ZdS )� metaclassNrP r r r r r\ � s r\ c @ s e Zd ZdS )�
use_metaclassNrP r r r r r] � s r] )r\ c @ s e Zd Zdd� Zdd� ZdS )�pickling_metaclassc C s t | �t |�ko| j|jkS r )�type� reduce_argsrF r r r rH � s
�zpickling_metaclass.__eq__c C s
t | jfS r )�create_dynamic_classr` r) r r r rS � s z pickling_metaclass.__reduce__N)r0 r1 r2 rH rS r r r r r^ � s r^ c C s t | |t� �}| |f|_|S r )r^ �dictr` )�name�bases�resultr r r ra � s
ra c @ s< e Zd ZdZdZdZdZdd� Zdd� ZeZ e
dd� �Z dS ) �
ZeroCopyBytesTc C s8 |dkr t | �jt�| �fd fS t | �jt| �ffS d S �N� �r_ � _reconstructr � PickleBuffer�bytes�r& �protocolr r r �
__reduce_ex__� s zZeroCopyBytes.__reduce_ex__c C s d� | jjt| ��S �Nz{}({!r})��format� __class__r0 rl r) r r r �__repr__� s zZeroCopyBytes.__repr__c
C sN t |��<}|j}t|�| kr,|W 5 Q R � S | |�W 5 Q R � S W 5 Q R X d S r ��
memoryview�objr_ ��clsrw �mr r r rj � s
zZeroCopyBytes._reconstructN� r0 r1 r2 �readonly� c_contiguous� f_contiguous�zero_copy_reconstructro rt �__str__� classmethodrj r r r r rf � s rf c @ s< e Zd ZdZdZdZdZdd� Zdd� ZeZ e
dd� �Z d S )
�ZeroCopyBytearrayFTc C s8 |dkr t | �jt�| �fd fS t | �jt| �ffS d S rg ri rm r r r ro � s z ZeroCopyBytearray.__reduce_ex__c C s d� | jjt| ��S rp rq r) r r r rt � s zZeroCopyBytearray.__repr__c
C sN t |��<}|j}t|�| kr,|W 5 Q R � S | |�W 5 Q R � S W 5 Q R X d S r ru rx r r r rj � s
z ZeroCopyBytearray._reconstructNr{ r r r r r� � s r� c @ sp e Zd ZdZdd� Zdd� Zedd� �Zedd � �Zed
d � �Z d d
� Z
dd� Z dd� Z dd� Z
edd� �ZdS )�PicklableNDArrayFc O s t j||�| _d S r )� _testbufferZndarray�array�r& r' �kwargsr r r r9 s zPicklableNDArray.__init__c C s" t | �}|�|�}| j| |_|S r )r_ �__new__r� )r& �idxry �newr r r � __getitem__ s
z PicklableNDArray.__getitem__c C s | j jS r )r� r| r) r r r r| s zPicklableNDArray.readonlyc C s | j jS r )r� r} r) r r r r} s z PicklableNDArray.c_contiguousc C s | j jS r )r� r~ r) r r r r~ s z PicklableNDArray.f_contiguousc C sb t |t�stS |jj| jjko`|jj| jjko`|jj| jjko`|jj| jjko`|j�� | j�� kS r ) �
isinstancer� �NotImplementedr� rr �shape�stridesr| �tobytesrF r r r rH s
����zPicklableNDArray.__eq__c C s t |t�stS | |k S r )r� r� r� rF r r r �__ne__! s
zPicklableNDArray.__ne__c C s. t | �� d| jj� d| jj� d| j�� � d�S )Nz(shape=z ,strides=z, bytes=�))r_ r� r� r� r� r) r r r rt & s zPicklableNDArray.__repr__c
C s� | j jstd��| j j| j j| j j| jr,dntjd�}t �
| j �}|dkr\t | �j ||ffS |�
� �$}t | �j |�� |ffW 5 Q R � S Q R X d S )Nz>Reconstructing a non-contiguous ndarray does not seem possibler )r� r� rr �flagsrh )r� �
contiguousr$ r� r� rr r| r� � ND_WRITABLEr rk r_ rj �rawr� )r& rn Zndarray_kwargs�pbrz r r r ro + s"
� �
�z PicklableNDArray.__reduce_ex__c C s, t |��}t|�� �}W 5 Q R X | |f|�S r )rv �listr� )ry rw r� rz �itemsr r r rj > s
z PicklableNDArray._reconstructN)r0 r1 r2 r r9 r� �propertyr| r} r~ rH r� rt ro r� rj r r r r r� � s
r� s; (lp0
L0L
aL1L
aF2.0
ac__builtin__
complex
p1
(F3.0
F0.0
tp2
Rp3
aL1L
aL-1L
aL255L
aL-255L
aL-256L
aL65535L
aL-65535L
aL-65536L
aL2147483647L
aL-2147483647L
aL-2147483648L
a(Vabc
p4
g4
ccopy_reg
_reconstructor
p5
(c__main__
C
p6
c__builtin__
object
p7
Ntp8
Rp9
(dp10
Vfoo
p11
L1L
sVbar
p12
L2L
sbg9
tp13
ag13
aL5L
a.an 0: ( MARK
1: l LIST (MARK at 0)
2: p PUT 0
5: L LONG 0
9: a APPEND
10: L LONG 1
14: a APPEND
15: F FLOAT 2.0
20: a APPEND
21: c GLOBAL '__builtin__ complex'
42: p PUT 1
45: ( MARK
46: F FLOAT 3.0
51: F FLOAT 0.0
56: t TUPLE (MARK at 45)
57: p PUT 2
60: R REDUCE
61: p PUT 3
64: a APPEND
65: L LONG 1
69: a APPEND
70: L LONG -1
75: a APPEND
76: L LONG 255
82: a APPEND
83: L LONG -255
90: a APPEND
91: L LONG -256
98: a APPEND
99: L LONG 65535
107: a APPEND
108: L LONG -65535
117: a APPEND
118: L LONG -65536
127: a APPEND
128: L LONG 2147483647
141: a APPEND
142: L LONG -2147483647
156: a APPEND
157: L LONG -2147483648
171: a APPEND
172: ( MARK
173: V UNICODE 'abc'
178: p PUT 4
181: g GET 4
184: c GLOBAL 'copy_reg _reconstructor'
209: p PUT 5
212: ( MARK
213: c GLOBAL '__main__ C'
225: p PUT 6
228: c GLOBAL '__builtin__ object'
248: p PUT 7
251: N NONE
252: t TUPLE (MARK at 212)
253: p PUT 8
256: R REDUCE
257: p PUT 9
260: ( MARK
261: d DICT (MARK at 260)
262: p PUT 10
266: V UNICODE 'foo'
271: p PUT 11
275: L LONG 1
279: s SETITEM
280: V UNICODE 'bar'
285: p PUT 12
289: L LONG 2
293: s SETITEM
294: b BUILD
295: g GET 9
298: t TUPLE (MARK at 172)
299: p PUT 13
303: a APPEND
304: g GET 13
308: a APPEND
309: L LONG 5
313: a APPEND
314: . STOP
highest protocol among opcodes = 0
s� ]q (K KG@ c__builtin__
complex
q(G@ G tqRqKJ����K�J���J ���M��J ��J ��J���J �J �(X abcqhccopy_reg
_reconstructor
q(c__main__
C
qc__builtin__
object
qNtqRq }q
(X fooq KX barq Kubh tq
h
Ke.a 0: ] EMPTY_LIST
1: q BINPUT 0
3: ( MARK
4: K BININT1 0
6: K BININT1 1
8: G BINFLOAT 2.0
17: c GLOBAL '__builtin__ complex'
38: q BINPUT 1
40: ( MARK
41: G BINFLOAT 3.0
50: G BINFLOAT 0.0
59: t TUPLE (MARK at 40)
60: q BINPUT 2
62: R REDUCE
63: q BINPUT 3
65: K BININT1 1
67: J BININT -1
72: K BININT1 255
74: J BININT -255
79: J BININT -256
84: M BININT2 65535
87: J BININT -65535
92: J BININT -65536
97: J BININT 2147483647
102: J BININT -2147483647
107: J BININT -2147483648
112: ( MARK
113: X BINUNICODE 'abc'
121: q BINPUT 4
123: h BINGET 4
125: c GLOBAL 'copy_reg _reconstructor'
150: q BINPUT 5
152: ( MARK
153: c GLOBAL '__main__ C'
165: q BINPUT 6
167: c GLOBAL '__builtin__ object'
187: q BINPUT 7
189: N NONE
190: t TUPLE (MARK at 152)
191: q BINPUT 8
193: R REDUCE
194: q BINPUT 9
196: } EMPTY_DICT
197: q BINPUT 10
199: ( MARK
200: X BINUNICODE 'foo'
208: q BINPUT 11
210: K BININT1 1
212: X BINUNICODE 'bar'
220: q BINPUT 12
222: K BININT1 2
224: u SETITEMS (MARK at 199)
225: b BUILD
226: h BINGET 9
228: t TUPLE (MARK at 112)
229: q BINPUT 13
231: h BINGET 13
233: K BININT1 5
235: e APPENDS (MARK at 3)
236: . STOP
highest protocol among opcodes = 1
s� �]q (K KG@ c__builtin__
complex
qG@ G �qRqKJ����K�J���J ���M��J ��J ��J���J �J �(X abcqhc__main__
C
q)�q}q(X fooqKX barq Kubhtq
h
Ke.u� 0: PROTO 2
2: ] EMPTY_LIST
3: q BINPUT 0
5: ( MARK
6: K BININT1 0
8: K BININT1 1
10: G BINFLOAT 2.0
19: c GLOBAL '__builtin__ complex'
40: q BINPUT 1
42: G BINFLOAT 3.0
51: G BINFLOAT 0.0
60: TUPLE2
61: q BINPUT 2
63: R REDUCE
64: q BINPUT 3
66: K BININT1 1
68: J BININT -1
73: K BININT1 255
75: J BININT -255
80: J BININT -256
85: M BININT2 65535
88: J BININT -65535
93: J BININT -65536
98: J BININT 2147483647
103: J BININT -2147483647
108: J BININT -2147483648
113: ( MARK
114: X BINUNICODE 'abc'
122: q BINPUT 4
124: h BINGET 4
126: c GLOBAL '__main__ C'
138: q BINPUT 5
140: ) EMPTY_TUPLE
141: NEWOBJ
142: q BINPUT 6
144: } EMPTY_DICT
145: q BINPUT 7
147: ( MARK
148: X BINUNICODE 'foo'
156: q BINPUT 8
158: K BININT1 1
160: X BINUNICODE 'bar'
168: q BINPUT 9
170: K BININT1 2
172: u SETITEMS (MARK at 147)
173: b BUILD
174: h BINGET 6
176: t TUPLE (MARK at 113)
177: q BINPUT 10
179: h BINGET 10
181: K BININT1 5
183: e APPENDS (MARK at 5)
184: . STOP
highest protocol among opcodes = 2
s� �]q (K KG@ cbuiltins
complex
qG@ G �qRqKJ����K�J���J ���M��J ��J ��J���J �J �(X abcqhc__main__
C
q)�q}q(X barqKX fooq Kubhtq
h
Ke.u� 0: PROTO 3
2: ] EMPTY_LIST
3: q BINPUT 0
5: ( MARK
6: K BININT1 0
8: K BININT1 1
10: G BINFLOAT 2.0
19: c GLOBAL 'builtins complex'
37: q BINPUT 1
39: G BINFLOAT 3.0
48: G BINFLOAT 0.0
57: TUPLE2
58: q BINPUT 2
60: R REDUCE
61: q BINPUT 3
63: K BININT1 1
65: J BININT -1
70: K BININT1 255
72: J BININT -255
77: J BININT -256
82: M BININT2 65535
85: J BININT -65535
90: J BININT -65536
95: J BININT 2147483647
100: J BININT -2147483647
105: J BININT -2147483648
110: ( MARK
111: X BINUNICODE 'abc'
119: q BINPUT 4
121: h BINGET 4
123: c GLOBAL '__main__ C'
135: q BINPUT 5
137: ) EMPTY_TUPLE
138: NEWOBJ
139: q BINPUT 6
141: } EMPTY_DICT
142: q BINPUT 7
144: ( MARK
145: X BINUNICODE 'bar'
153: q BINPUT 8
155: K BININT1 2
157: X BINUNICODE 'foo'
165: q BINPUT 9
167: K BININT1 1
169: u SETITEMS (MARK at 144)
170: b BUILD
171: h BINGET 6
173: t TUPLE (MARK at 110)
174: q BINPUT 10
176: h BINGET 10
178: K BININT1 5
180: e APPENDS (MARK at 5)
181: . STOP
highest protocol among opcodes = 2
s� ��� ]�(K KG@ �builtins��complex���G@ G ��R�KJ����K�J���J ���M��J ��J ��J���J �J �(�abc�h�__main__��C���)��}�(�bar�K�foo�Kubh
t�hKe.u� 0: PROTO 4
2: FRAME 168
11: ] EMPTY_LIST
12: MEMOIZE
13: ( MARK
14: K BININT1 0
16: K BININT1 1
18: G BINFLOAT 2.0
27: SHORT_BINUNICODE 'builtins'
37: MEMOIZE
38: SHORT_BINUNICODE 'complex'
47: MEMOIZE
48: STACK_GLOBAL
49: MEMOIZE
50: G BINFLOAT 3.0
59: G BINFLOAT 0.0
68: TUPLE2
69: MEMOIZE
70: R REDUCE
71: MEMOIZE
72: K BININT1 1
74: J BININT -1
79: K BININT1 255
81: J BININT -255
86: J BININT -256
91: M BININT2 65535
94: J BININT -65535
99: J BININT -65536
104: J BININT 2147483647
109: J BININT -2147483647
114: J BININT -2147483648
119: ( MARK
120: SHORT_BINUNICODE 'abc'
125: MEMOIZE
126: h BINGET 6
128: SHORT_BINUNICODE '__main__'
138: MEMOIZE
139: SHORT_BINUNICODE 'C'
142: MEMOIZE
143: STACK_GLOBAL
144: MEMOIZE
145: ) EMPTY_TUPLE
146: NEWOBJ
147: MEMOIZE
148: } EMPTY_DICT
149: MEMOIZE
150: ( MARK
151: SHORT_BINUNICODE 'bar'
156: MEMOIZE
157: K BININT1 2
159: SHORT_BINUNICODE 'foo'
164: MEMOIZE
165: K BININT1 1
167: u SETITEMS (MARK at 150)
168: b BUILD
169: h BINGET 10
171: t TUPLE (MARK at 119)
172: MEMOIZE
173: h BINGET 14
175: K BININT1 5
177: e APPENDS (MARK at 13)
178: . STOP
highest protocol among opcodes = 4
s% �c__builtin__
set
q ]q(KKe�qRq.s% �c__builtin__
xrange
q K KK�qRq.s� �cCookie
SimpleCookie
q )�qUkeyqcCookie
Morsel
q)�q(UcommentqU qUdomainqhUsecureqhUexpiresq hUmax-ageq
hUversionq hUpathq hUhttponlyq
hu}q(U coded_valueqUvalueqhhhhubs}qb.s" �c__builtin__
set
q ]qKa�qRq.s �cexceptions
?
q )Rq.sI �cexceptions
UnicodeEncodeError
q (UasciiqX fooqK KUbadqtqRq.c C s� t � } d| _d| _ddddg}d}d}d}|�dd || | d || | d || | d g � d
d
| | f}|�|� |�|� |�d � |S ) Nr � r g @y @ � � ������abcrh )rD �foo�bar�extend�append)�cr! Zuint1maxZuint2maxZint4max�yr r r � create_data& s. �
r� c @ s� e Zd Ze� Zd\dd�Zdd� Zdd� Zdd � Zd
d � Z d d
� Z
dd� Z dd� Z dd� Z
dd� Zdd� Zdd� Zdd� Zd d � Zd d � Zd d!� Zd"d#� Zed$d%� �Zed&d'� �Zd(d)� Zd*d+� Zd,d-� Zd.d/� Z d0d1� Z ed2d3� �Z ed4d5� �Z ed6d7� �Z d8d9� Z!d:d;� Z"d<d=� Z#d>d?� Z$d@dA� Z%edBdC� �Z&dDdE� Z'dFdG� Z(dHdI� Z)dJdK� Z*dLdM� Z+dNdO� Z,dPdQ� Z-dRdS� Z.dTdU� Z/dVdW� Z0dXdY� Z1e2dZd[� �Z3dS )]�AbstractUnpickleTestsNc C s� |dkrd� ||�}| j|||d� | jt|�t|�|d� t|d�rn| j|j|j|d� | j|j|j|d� t|d�r�| j|j |j |d� |j D ]@}| jt||�t||�|d� | jt
||d�t
||d�|d� q�dS )zKUtility method to verify if two objects are copies of each others.
Nz{!r} is not a copy of {!r})�msgrE � __slots__) rr � assertEqual�assertIsr_ �hasattrZassertDictEqualrE � assertIsNotZassertListEqualr� �getattr)r& rw Zobjcopyr� Zslotr r r �assert_is_copy@ s&
�
�z$AbstractUnpickleTests.assert_is_copyc C s� | j |d��p | �|��Z z| �|� W nD tk
rl } z&tjdkrZtd||jj|f � � W 5 d }~X Y nX W 5 Q R X W 5 Q R X d S )N)�datar z%-32r - %s: %s) �subTest� assertRaises�loads�
BaseExceptionr �verbose�printrs r0 )r& �errorsr� �excr r r �check_unpickling_errorR s �
�z,AbstractUnpickleTests.check_unpickling_errorc C s | � | j| �t�� d S r )r� � _testdatar� �DATA0r) r r r �test_load_from_data0] s z*AbstractUnpickleTests.test_load_from_data0c C s | � | j| �t�� d S r )r� r� r� �DATA1r) r r r �test_load_from_data1` s z*AbstractUnpickleTests.test_load_from_data1c C s | � | j| �t�� d S r )r� r� r� �DATA2r) r r r �test_load_from_data2c s z*AbstractUnpickleTests.test_load_from_data2c C s | � | j| �t�� d S r )r� r� r� �DATA3r) r r r �test_load_from_data3f s z*AbstractUnpickleTests.test_load_from_data3c C s | � | j| �t�� d S r )r� r� r� �DATA4r) r r r �test_load_from_data4i s z*AbstractUnpickleTests.test_load_from_data4c C s� t dftdftdffD ]z\}}|j�d�}d�d|�}| �||� | �|�� d�d|�}| �||� | �|�� d�d|�}| �||� | �|�� qd S )Nr r �asciis (i__main__
X
p0
(dp1
b.� Xs (c__main__
X
q oq}qb.s �(c__main__
X
q oq}qb.)rD rI rL r0 �encode�replacer� r� )r& �Xr' ZxnameZpickle0Zpickle1Zpickle2r r r �test_load_classic_instancel s" � � �z0AbstractUnpickleTests.test_load_classic_instancec C sV d}dt |��d� d }| �|�}| �||� dt |��d� d }| �t|� d S )Nl ���� � Ir� �
.s JUNK
.)rW r� r� r� r� �
ValueError)r& Zmaxint64r� �gotr r r �
test_maxint64� s
z#AbstractUnpickleTests.test_maxint64c C sX | � t�}| �|tddg�� | � t�}| �t|�ttd��� | �t|�ttd��� | � t�}| �t|�t � | �t|�
� �dg� | �|d j d� t D ]2}t
�d|j�d��}| � |�}| �t|�|� q�| � t
�dd ��}| �t|�t� | � t�}| �t|�t� | �|jd
� | �|jd� | �|jd� | �|jd� | �|jd � d S ) Nr r� r rh �keyrR � ?r� �
StandardErrorr� Zbad)r� �DATA_SETr� �set� DATA_XRANGEr_ �ranger� � DATA_COOKIEr �keysrR � python2_exceptions_without_args�exception_pickler� r0 r� r� � Exception�
DATA_UEERR�UnicodeEncodeError�object�encoding�start�end�reason)r& �loadedr� r� r r r �test_unpickle_from_2x� s,
z+AbstractUnpickleTests.test_unpickle_from_2xc C sF | � | jddd�d� | � | jddd�d� | � | jddd�d� d S )Ns S'a\x00\xa0'
.rl �r� s a �s Ua �.s �Ua �.�r� r� r) r r r � test_load_python2_str_as_bytes� s
��
��
��z4AbstractUnpickleTests.test_load_python2_str_as_bytesc C sF | � | jddd�d� | � | jddd�d� | � | jddd�d� d S )Ns V\u03c0
.rl r� u πs X π.s
�X π.r� r) r r r � test_load_python2_unicode_as_str� s
��
��
��z6AbstractUnpickleTests.test_load_python2_unicode_as_strc C s2 | � | jtjt�dd� d tj dd�d� d S )N�<Ii, s, xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxrl r� )r� r� r � BINSTRING�struct�pack�STOPr) r r r �#test_load_long_python2_str_as_bytes� s
�����z9AbstractUnpickleTests.test_load_long_python2_str_as_bytesc C s\ | � | �d�� | �| �d�d� | �| �d�d� | �| �d�d� | �| �d�d� d S )Ns N.s �.Ts �.Fs I01
.s I00
.)� assertIsNoner� r� r) r r r �test_constants� s
z$AbstractUnpickleTests.test_constantsc C s | j ddd�}| �|d� d S )Ns �U q .zkoi8-rr� � )r� r� )r& �emptyr r r �test_empty_bytestring� s z+AbstractUnpickleTests.test_empty_bytestringc C s d}| � | �|�d� d S )Ns �C€ .� € r� �r& �dumpedr r r �test_short_binbytes� s z)AbstractUnpickleTests.test_short_binbytesc C s d}| � | �|�d� d S )Ns �B € .r� r� r� r r r �
test_binbytes� s z#AbstractUnpickleTests.test_binbytesc C s d}| � tjtf|� d S )Ns
�B����xyzq .�r� r �UnpicklingError�
OverflowErrorr� r r r �test_negative_32b_binbytes� s �z0AbstractUnpickleTests.test_negative_32b_binbytesc C s d}| � tjtf|� d S )Ns
�X����xyzq .r� r� r r r � test_negative_32b_binunicode s �z2AbstractUnpickleTests.test_negative_32b_binunicodec C s d}| � | �|�d� d S )Ns ��€ .� € r� r� r r r �test_short_binunicode s z+AbstractUnpickleTests.test_short_binunicodec C s& | � td� | �ddg| �d�� d S )Ns g0
p0)�d s ((Kdtp0
h l.)))r� �KeyErrorr� r� r) r r r �
test_misc_get s
�z#AbstractUnpickleTests.test_misc_getc C s d}| � | �|�d� d S )Ns �� € .r� r� r� r r r �test_binbytes8 s z$AbstractUnpickleTests.test_binbytes8c C s d}| � | �|�d� d S )Ns �� € .r� r� r� r r r �test_binunicode8 s z&AbstractUnpickleTests.test_binunicode8c C s d}| � | �|�td�� d S )Ns �� xxx.s xxx)r� r� � bytearrayr� r r r �test_bytearray8 s z%AbstractUnpickleTests.test_bytearray8c C s d}| � tjtf|� d S )Ns �� € .r� r� r r r �test_large_32b_binbytes8! s �z.AbstractUnpickleTests.test_large_32b_binbytes8c C s d}| � tjtf|� d S )Ns �� € .r� r� r r r �test_large_32b_bytearray8' s �z/AbstractUnpickleTests.test_large_32b_bytearray8c C s d}| � tjtf|� d S )Ns �� € .r� r� r r r �test_large_32b_binunicode8- s �z0AbstractUnpickleTests.test_large_32b_binunicode8c C s8 d}| � |�}| �|g fd � | �|d |d � d S )Ns ((lp100000
g100000
t.r� r r �r� r� r� �r& �pickled� unpickledr r r �test_get3 s
z AbstractUnpickleTests.test_getc C s8 d}| � |�}| �|g fd � | �|d |d � d S )Ns (]q�h�t.r� r r r r r r r � test_binget9 s
z!AbstractUnpickleTests.test_bingetc C s8 d}| � |�}| �|g fd � | �|d |d � d S )Ns (]r j t.r� r r r r r r r �test_long_binget? s
z&AbstractUnpickleTests.test_long_bingetc C s8 d}| � |�}| �|g fd � | �|d |d � d S )Ns ((l2t.r� r r r r r r r �test_dupE s
z AbstractUnpickleTests.test_dupc C s d}| � t|� d S )Ns Va
p-1
.�r� r� r� r r r �test_negative_putK s z'AbstractUnpickleTests.test_negative_putc C s d}| � t|� d S )Ns �X ar����.r r� r r r �test_negative_32b_binputP s z.AbstractUnpickleTests.test_negative_32b_binputc C s | � td� d S )Ns S'\'
.r r) r r r �test_badly_escaped_stringV s z/AbstractUnpickleTests.test_badly_escaped_stringc
C s: ddddddddd d
d d d
g
}|D ]}| � tj|� q"d S )Ns S'
.s S"
.s S'
.s S"
.s S'"
.s S"'
.s S' '
.s S" "
.s S ''
.s S ""
.s S
.s S
.s S.)r� r r� �r& Z
badpickles�pr r r �test_badly_quoted_stringY s �
z.AbstractUnpickleTests.test_badly_quoted_stringc C s0 ddddg}|D ]\}}| � | �|�|� qd S )N)s S''
.r� )s S""
.r� )s S"\n"
.�
)s S'\n'
.r r� )r& Z goodpicklesr �expectedr r r � test_correctly_quoted_stringk s � z2AbstractUnpickleTests.test_correctly_quoted_stringc C s d}| � | �|�d� d S )Ns �� I42
.�* r� )r& r
r r r �test_frame_readlines s z)AbstractUnpickleTests.test_frame_readlinec C s d}| � |�}| �t|�t� | �|tdd�� | �t|�ddddddg� d }| �| � |�tj� d
}| �| � |�tj � d D ]:}d | d
}| � |�}| �t|�t
� | �t |�d� q�dD ]B}d| d }| � |�}| �t|�t j
� | �|t �
ddi�� q�d S )Ns �c__builtin__
xrange
KKK�R.r � r� � � rh � s �c__builtin__
reduce
.s �cwhichdb
whichdb
.)s Exceptionr� s �cexceptions
s
Uugh�R.Zugh)s UserDicts IterableUserDicts
�(cUserDict
s
o}Udata}KKssb.)r� r� r_ r� r� r� � functools�reduce�dbm�whichdbr� rW � collections�UserDict)r& r
r rc r r r �test_compat_unpickle{ s*
�
z*AbstractUnpickleTests.test_compat_unpicklec C s. | � | �d�d� | �td� | �td� d S )Ns cbuiltins
int
)R.r s N)R.s cbuiltins
int
NR.)r� r� r� � TypeErrorr) r r r �test_bad_reduce� s z%AbstractUnpickleTests.test_bad_reducec C s8 t jtf}| �| �d�d� | �|d� | �|d� d S )Ns cbuiltins
int
)�.r s cbuiltins
len
)�.s cbuiltins
int
N�.�r r� r* r� r� r� �r& �errorr r r �test_bad_newobj� s
z%AbstractUnpickleTests.test_bad_newobjc C sD t jtf}| �| �d�d� | �|d� | �|d� | �|d� d S )Ns cbuiltins
int
)}�.r s cbuiltins
len
)}�.s cbuiltins
int
N}�.s cbuiltins
int
)N�.r, r- r r r �test_bad_newobj_ex� s
z(AbstractUnpickleTests.test_bad_newobj_exc , C sx ddddddddd d
d d d
ddddddddddddddd d d d d d!d"d#d$d%d&d'd(d)d*d+d,g,}|D ]}| � | j|� q`d S )-N� .� 0� 1� 2s (2� Rs )R� as Na� bs Nb� d� es (es ibuiltins
list
� l� os (os p1
s q s r � ss Nss NNs� t� us (us }(Nu� �s )�� �� �s N�� �s N�s NN�� �s (�� �� �s )}�� �s Vlist
�� ��r� Zbad_stack_errorsr r r r �test_bad_stack� s^ �.z$AbstractUnpickleTests.test_bad_stackc C s\ ddddddddd d
d d d
ddddddddddddddd d d g }|D ]}| � | j|� qDd S ) Ns N(.s N(2s cbuiltins
list
)(Rs cbuiltins
list
()Rs ]N(as cbuiltins
ValueError
)R}(bs cbuiltins
ValueError
)R(}bs (Nds N(p1
s N(q s N(r s }NN(ss }N(Nss }(NNss }((us cbuiltins
list
)(�s cbuiltins
list
()�s N(�s NN(�s N(N�s NNN(�s NN(N�s N(NN�s ]((�s cbuiltins
list
)}(�s cbuiltins
list
)(}�s cbuiltins
list
()}�s Vbuiltins
(Vlist
�s Vbuiltins
Vlist
(�s N(�rH r r r r �
test_bad_mark� sB �#z#AbstractUnpickleTests.test_bad_markc U C s� | � td� | � td� ddddddd d
d d d
ddddddddddddddd d d d d d!d"d#d$d%d&d'd(d)d*d+d,d-d.d/d0d1d2d3d4d5d6d7d8d9d:d;d<d=d>d?d@dAdBdCdDdEdFdGdHdIdJdKdLdMdNdOdPdQdRdSdTdUdVdWgU}|D ]}| � | j|� q�d S )XN� � N� Bs B s B s B ab� Cs Cs Cab� Fs F0.0s F0.00� Gs G r� s I0� Js J � K� Ls L0s L10s L0Ls L10L� Ms M � Ss S'abc'� Ts T s T s T ab� Us Us Uab� Vs Vabcr� s X s X s X abs (cs
(cbuiltinss (cbuiltins
s (cbuiltins
lists Ngs Ng0s (is
(ibuiltinss (ibuiltins
s (ibuiltins
lists Nhs Njs Nj s Nps Np0s Nqs Nrs Nr � �� �� �s �� �s � � �� �s � � �s �s �ab� �s � s � s � ab� �s � s � s � ab� �s � s � s � ab� �s � s � s
� N)r� �EOFErrorZtruncated_errorsr r r r �test_truncated_data s� �Yz)AbstractUnpickleTests.test_truncated_datac s^ t d�}t d�}t�t� | �tjt� tj� dt� | �tjj
t� t tj� td�d��}|�
|�d�� W 5 Q R X t tj� td�d��}|�
|�d�� W 5 Q R X | �td� | �td � dd l}d
�g �t�d �� � ��fd d
�}tj|d�}tj|d�}|�� |�� � �� |j�� |� � |� � ddlm} | �dd� �D �|gd � d S )NzI
import threading
barrier = threading.Barrier(2)
zs
import locker
locker.barrier.wait()
class ToBeUnpickled(object):
pass
r z locker.py�wb�utf-8zlocking_import.py�locker�locking_imports' �clocking_import
ToBeUnpickled
q )�q.r c s � � � ��t���� d S r )�waitr� r r� r ��barrierZ pickle_bytes�resultsr r �t� s z:AbstractUnpickleTests.test_unpickle_module_race.<locals>.t)�target)�
ToBeUnpickledc S s g | ] }t |��qS r )r_ ��.0r! r r r �
<listcomp>� s zCAbstractUnpickleTests.test_unpickle_module_race.<locals>.<listcomp>r� )r �os�mkdirr Z
addCleanup�shutil�rmtree�sys�path�insert�remove�open�joinr8 r� r
rh � threading�Barrier�Threadr� rj rl ri rp r� ) r& Z
locker_moduleZlocking_import_module�frh rn �t1�t2rp r rk r �test_unpickle_module_race` s>
�
�z/AbstractUnpickleTests.test_unpickle_module_race)N)4r0 r1 r2 r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� � requires_32br� r� r r r r r r r r
r r r r r r r r r r r) r+ r/ r0 rI rJ re r r� r r r r r� ; sj
9
2'_r� c @ s e Zd ZdZejZdd� ZejZdd� Zdd� Z dd � Z
e d
fd d �Z d
d� Z
dd� Zdd� Ze d
fdd�Zdd� Zdd� Zdd� Ze d
fdd �Zd d � Zd d � Zd!d"� Ze d
fd#d$�Zd%d&� Zd'd(� Zd)d*� Ze d
fd+d,�Z d-d.� Z d/d0� Z d1d2� Z e d
fd3d4�Z d5d6� Z!d7d8� Z"d9d:� Z#d;d<� Z$d=d>� Z%d?d@� Z&dAdB� Z'dCdD� Z(dEdF� Z)dGdH� Z*dIdJ� Z+dKdL� Z,dMdN� Z-dOdP� Z.dQdR� Z/dSdT� Z0dUdV� Z1dWdX� Z2dYdZ� Z3d[d\� Z4d]d^� Z5d_d`� Z6dadb� Z7dcdd� Z8dedf� Z9dgdh� Z:e;didjdk�dldm� �Z<dndo� Z=dpdq� Z>drds� Z?dtdu� Z@dvdw� ZAdxdy� ZBdzd{� ZCd|d}� ZDd~d� ZEd�d�� ZFd�d�� ZGd�d�� ZHd�d�� ZId�d�� ZJd�d�� ZKd�d�� ZLd�d�� ZMd�d�� ZNd�d�� ZOd�d�� ZPd�d�� ZQd�d�� ZRd�d�� ZSd�d�� ZTd�d�� ZUd�d�� ZVd�d�� ZWd�d�� ZXd�d�� ZYd�d�� ZZd�d�� Z[d�d�� Z\d�d�� Z]d�d�� Z^e_d�d�� �Z`d�d�� Zad�d�� Zbd�d�� Zcd�d�� Zdd�d�� Zed�d�� Zfd�d�� Zgd�dÄ Zhd�dń Zid�Zjd�Zkd�dɄ Zlemjnd�d˄ �Zod�d̈́ Zpd�dτ Zqemjnd�dф �Zrd�dӄ Zsd�dՄ Ztd�dׄ Zud�dل Zvd�dۄ Zwd�d݄ Zxd�d߄ Zyd�d� Zzd�d� Z{d�d� Z|d�d� Z}d�d� Z~d�d� Zd�d� Z�e���e�d�kd�d�d� �Z�d�S )��AbstractPickleTestsFc C s d S r r r) r r r �setUp� s zAbstractPickleTests.setUpc C s� t D ]�}td�}| �||�}| �|�}| �||� d}| �||�}| �|�}| �||� td|�}| �||�}| �|�}| �||� qd S )Nr! )r r r )� protocolsrU �dumpsr� r� rX �r& �protor! �sr� r r r � test_misc� s
z AbstractPickleTests.test_miscc C s6 | j }tD ]&}| �||�}| �|�}| �||� q
d S r )r� r� r� r� r� )r& r r� r� r� r r r �test_roundtrip_equality� s
z+AbstractPickleTests.test_roundtrip_equalityc C sj ddl m} ddlm} dtfdtffD ]<\}}| �| j|�}|� }|||d� |�� }| � ||� q(d S )Nr )�StringIO��disr )�out)
r, r� r r� � DATA0_DIS� DATA1_DISr� r� r5 r� )r& r� r� r� r r� Zfileliker� r r r �dont_test_disassembly� s z)AbstractPickleTests.dont_test_disassemblyr c C st |� }|� |� t|tjd �D ]N}| �||�}| �|�}| �||� ||�}| �t|�d� | � |d |� q d S �Nr r )
r� r� r �HIGHEST_PROTOCOLr� r� �assertIsInstancer� �lenr� ) r& ry �aslist� minprotocol�lr� r� r! r� r r r �_test_recursive_list� s
z(AbstractPickleTests._test_recursive_listc C s | � t� d S r )r� r� r) r r r �test_recursive_list� s z'AbstractPickleTests.test_recursive_listc C s | j tdd� d S �Nr� )r� )r� �MyListr) r r r � test_recursive_list_subclass� s z0AbstractPickleTests.test_recursive_list_subclassc C s | j tdd� d� d S )Nc S s | j S r �r� r r r r �<lambda>� rK z>AbstractPickleTests.test_recursive_list_like.<locals>.<lambda>�r� )r� �REX_sixr) r r r �test_recursive_list_like� s z,AbstractPickleTests.test_recursive_list_likec C s, |� f}|d � |� t|tjd �D ]r}| �||�}| �|�}| �|t� | �t |�d� | �|d |� ||d �}| �t |�d� | �
|d |� q&|\}t|tjd �D ]v}| �||�}| �|�}| �||� ||�}| �t |�d� | �|d t� | �t |d �d� | �
|d d |� q�d S r< ) r� r� r r� r� r� r� �tupler� r� r� ) r& ry r� r� rn r� r� r! r� r r r � _test_recursive_tuple_and_list� s*
z2AbstractPickleTests._test_recursive_tuple_and_listc C s | � t� d S r )r� r� r) r r r � test_recursive_tuple_and_list s z1AbstractPickleTests.test_recursive_tuple_and_listc C s | j tdd� d S r� )r� r� r) r r r �&test_recursive_tuple_and_list_subclass s z:AbstractPickleTests.test_recursive_tuple_and_list_subclassc C s | j tdd� d� d S )Nc S s | j S r r� r r r r r� rK zHAbstractPickleTests.test_recursive_tuple_and_list_like.<locals>.<lambda>r� )r� r� r) r r r �"test_recursive_tuple_and_list_like s z6AbstractPickleTests.test_recursive_tuple_and_list_likec C sx |� }||d< t |tjd �D ]T}| �||�}| �|�}| �||� ||�}| �t|�� �dg� | � |d |� q d S �Nr )
r� r r� r� r� r� r� r� r� r� � r& ry �asdictr� �dr� r� r! r� r r r �_test_recursive_dict s
z(AbstractPickleTests._test_recursive_dictc C s | � t� d S r )r� rb r) r r r �test_recursive_dict s z'AbstractPickleTests.test_recursive_dictc C s | j tdd� d S r� )r� �MyDictr) r r r � test_recursive_dict_subclass s z0AbstractPickleTests.test_recursive_dict_subclassc C s | j tdd� d� d S )Nc S s | j S r ��tabler r r r r� ! rK z>AbstractPickleTests.test_recursive_dict_like.<locals>.<lambda>�r� )r� � REX_sevenr) r r r �test_recursive_dict_like s z,AbstractPickleTests.test_recursive_dict_likec C s. |� f}||d d< t |tjd �D ]t}| �||�}| �|�}| �|t� | �t|�d� | �|d |� ||d �}| �t |�dg� | �
|d |� q$|\}t |tjd �D ]x}| �||�}| �|�}| �||� ||�}| �t |�dg� | �|d t� | �t|d �d� | �
|d d |� q�d S r< ) r� r r� r� r� r� r� r� r� r� r� � r& ry r� r� rn r� r� r! r� r r r � _test_recursive_tuple_and_dict# s*
z2AbstractPickleTests._test_recursive_tuple_and_dictc C s | � t� d S r )r� rb r) r r r � test_recursive_tuple_and_dict= s z1AbstractPickleTests.test_recursive_tuple_and_dictc C s | j tdd� d S r� )r� r� r) r r r �&test_recursive_tuple_and_dict_subclass@ s z:AbstractPickleTests.test_recursive_tuple_and_dict_subclassc C s | j tdd� d� d S )Nc S s | j S r r� r r r r r� D rK zHAbstractPickleTests.test_recursive_tuple_and_dict_like.<locals>.<lambda>r� )r� r� r) r r r �"test_recursive_tuple_and_dict_likeC s z6AbstractPickleTests.test_recursive_tuple_and_dict_likec C s� |� }d|t |�< t|tjd �D ]t}| �||�}| �|�}| �||� ||�}| �t|� � �d� | �t
|� � �d t � | � t
|� � �d j |� q"d S r� )
rQ r� r r� r� r� r� r� r� r� r� r� rR r� r r r �_test_recursive_dict_keyF s
z,AbstractPickleTests._test_recursive_dict_keyc C s | � t� d S r )r� rb r) r r r �test_recursive_dict_keyT s z+AbstractPickleTests.test_recursive_dict_keyc C s | j tdd� d S r� )r� r� r) r r r � test_recursive_dict_subclass_keyW s z4AbstractPickleTests.test_recursive_dict_subclass_keyc C s | j tdd� d� d S )Nc S s | j S r r� r r r r r� [ rK zBAbstractPickleTests.test_recursive_dict_like_key.<locals>.<lambda>r� )r� r� r) r r r � test_recursive_dict_like_keyZ s z0AbstractPickleTests.test_recursive_dict_like_keyc C sN |� f}d|d t |�< t|tjd �D ]�}| �||�}| �|�}| �|t� | �t |�d� | �|d |� ||d �}| �t |�d� | �t
|� � �d t � | � t
|� � �d j
|� q(|\}t|tjd �D ]t}| �||�}| �|�}| �||� ||�}| �t |�d� | �t
|� � �d t � | � t
|� � �d j
d |� q�d S r� )rQ r� r r� r� r� r� r� r� r� r� r� r� rR r� r r r �"_test_recursive_tuple_and_dict_key] s*
z6AbstractPickleTests._test_recursive_tuple_and_dict_keyc C s | � t� d S r )r� rb r) r r r �!test_recursive_tuple_and_dict_keyy s z5AbstractPickleTests.test_recursive_tuple_and_dict_keyc C s | j tdd� d S r� )r� r� r) r r r �*test_recursive_tuple_and_dict_subclass_key| s z>AbstractPickleTests.test_recursive_tuple_and_dict_subclass_keyc C s | j tdd� d� d S )Nc S s | j S r r� r r r r r� � rK zLAbstractPickleTests.test_recursive_tuple_and_dict_like_key.<locals>.<lambda>r� )r� r� r) r r r �&test_recursive_tuple_and_dict_like_key s z:AbstractPickleTests.test_recursive_tuple_and_dict_like_keyc C s� t � }|�t|�� tdtjd �D ]`}| �||�}| �|�}| �|t � | � t
|�d� | �t |�d t� | � t |�d j
|� q$|\}tdtjd �D ]\}| �||�}| �|�}| �|t� | �|j
t � | � t
|j
�d� | � t |j
�d |� q�d S )Nr! r r )r� �addrQ r� r r� r� r� r� r� r� r� r� rR �r& r� r� r� r! r r r �test_recursive_set� s"
z&AbstractPickleTests.test_recursive_setc C s^ t � }||_tD ]H}| �||�}| �|�}| �|t � | �t|�t|�� | �|j|� qd S r ) rO �attrr� r� r� r� r� �dirr� )r& �ir� r� r! r r r �test_recursive_inst� s
z'AbstractPickleTests.test_recursive_instc C s� g }d|i}t � }||_|�|� tD ]�}| �||�}| �|�}| �|t� | �t |�d� | �t
|d �t
|�� | �t|d j� � �dg� | � |d jd |� q&d S r� )
rO r� r� r� r� r� r� r� r� r� r� r� r� )r& r� r� r� r� r� r! r r r �test_recursive_multi� s
z(AbstractPickleTests.test_recursive_multic C s� t � }||g�|_t|j�}tD ]f}| �||�}| �|�}| �|j|� | �t|j�d� | �t |j�d t � | �
t |j�d |� q |j}tD ]`}| �||�}| �|�}| �||� | �t|�d� | �t |�d t � | �
t |�d j|� q�d S r� ) rO r� r_ r� r� r� r� r� r� r� r� )r& �factory�orn r� r� r! r r r �#_test_recursive_collection_and_inst� s$
z7AbstractPickleTests._test_recursive_collection_and_instc C s | � t� d S r )r� r� r) r r r � test_recursive_list_and_inst� s z0AbstractPickleTests.test_recursive_list_and_instc C s | � t� d S r )r� r� r) r r r � test_recursive_tuple_and_inst� s z1AbstractPickleTests.test_recursive_tuple_and_instc C s | � tj� d S r )r� rb �fromkeysr) r r r � test_recursive_dict_and_inst� s z0AbstractPickleTests.test_recursive_dict_and_instc C s | � t� d S r )r� r� r) r r r �test_recursive_set_and_inst� s z/AbstractPickleTests.test_recursive_set_and_instc C s | � t� d S r )r� � frozensetr) r r r �!test_recursive_frozenset_and_inst� s z5AbstractPickleTests.test_recursive_frozenset_and_instc C s | � t� d S r )r� r� r) r r r �%test_recursive_list_subclass_and_inst� s z9AbstractPickleTests.test_recursive_list_subclass_and_instc C s | � t� d S r )r� �MyTupler) r r r �&test_recursive_tuple_subclass_and_inst� s z:AbstractPickleTests.test_recursive_tuple_subclass_and_instc C s | � tj� d S r )r� r� r� r) r r r �%test_recursive_dict_subclass_and_inst� s z9AbstractPickleTests.test_recursive_dict_subclass_and_instc C s | � t� d S r )r� �MySetr) r r r �$test_recursive_set_subclass_and_inst� s z8AbstractPickleTests.test_recursive_set_subclass_and_instc C s | � t� d S r )r� � MyFrozenSetr) r r r �*test_recursive_frozenset_subclass_and_inst� s z>AbstractPickleTests.test_recursive_frozenset_subclass_and_instc C sJ t � }||_tD ]4}| �||�}| �|�}| �|t � | �|j|� qd S r )� REX_state�stater� r� r� r� r� r� r r r �test_recursive_inst_state� s
z-AbstractPickleTests.test_recursive_inst_statec C s� t � f}||d _tD ]X}| �||�}| �|�}| �|t� | �t|�d� | �|d t � | � |d j|� q|\}tD ]X}| �||�}| �|�}| �|t � | �|jt� | �t|j�d� | � |jd |� qzd S r< )
r� r� r� r� r� r� r� r� r� r� )r& rn r� r� r! r r r �#test_recursive_tuple_and_inst_state� s"
z7AbstractPickleTests.test_recursive_tuple_and_inst_statec C sL dddddddg}t D ]0}|D ]&}| �||�}| �|�}| �||� q qd S )Nr� z<\u>u <\ሴ>z<
>z<\>u <\𒍅>u <�>�r� r� r� r� )r& Zendcasesr� �ur �u2r r r � test_unicode s �
z AbstractPickleTests.test_unicodec C s4 d}t D ]&}| �||�}| �|�}| �||� qd S )Nu 𒍅r� )r& rn r� r r� r r r �test_unicode_high_plane s
z+AbstractPickleTests.test_unicode_high_planec C s� t D ]�}dD ]"}| �||�}| �|| �|�� q dd� td�D �D ]"}| �||�}| �|| �|�� qBdd� td�D �D ]"}| �||�}| �|| �|�� qxqd S )N�rK � xyzs, xyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzxyzc S s g | ]}t |g��qS r �rl �rr r� r r r rs s z2AbstractPickleTests.test_bytes.<locals>.<listcomp>� c S s g | ]}t ||g��qS r r� r� r r r rs # s )r� r� r� r� r� )r& r� r� r r r r �
test_bytes s z AbstractPickleTests.test_bytesc C s� t D ]�}dD ]�}t|�}| �||�}| �|�}| �||� | �||� |dkrn| �d|� | �tt j
|�� q |dkr�| �d|� | �tt j |�� q |dkr | � d|� | �tt j
|�� q qd S )Nr� r s bytearrayr! rh )r� r r� r� r� r� �assertIn�
assertTruer r �GLOBAL� STACK_GLOBAL� assertNotIn�
BYTEARRAY8)r& r� r� r[ r Zbbr r r �test_bytearray' s
z"AbstractPickleTests.test_bytearrayc C sT t D ]J}tj}|r| |fD ]&}| �||�}| �|�}| �||� q |d? }qqd S r� )r� rx �maxsizer� r� r� )r& r� r r r� Zn2r r r � test_ints: s
z AbstractPickleTests.test_intsc C s� t D ]`}dD ]V}d|> }|d ||d fD ]6}|| fD ]&}| �||�}| �|�}| �||� q8q*q qtdd�}||d> 7 }|| fD ]6}| �|d�}| �|�}| �t|�t� | �||� q�d S )N)r � i� i� � i r Zdeadbeeffeedface� i@B r� )r� r� r� r� �intr� r_ r� ) r& r� ZnbitsZnbaseZnposr r r� r r r r � test_longD s
z AbstractPickleTests.test_longc C sf ddddddddd d
d g }|d d
� |D � }t D ]0}|D ]&}| �||�}| �|�}| �||� q8q0d S )Ng g g+�p�h g�Z��*) g_D�� 9g�������?g �?g ��Q� @g�m�"wp@g�W�T��Dgꌠ9Y>)Fc S s g | ]
}| �qS r r rq r r r rs ^ s z2AbstractPickleTests.test_float.<locals>.<listcomp>r� )r& Z test_valuesr� rR r r� r r r �
test_float[ s �
z AbstractPickleTests.test_float�LC_ALL�de_DE�fr_FRc C s | � | �dd�dd� d� d S )Ng333333�?r r s F1.)r� r� r) r r r �test_float_formate s z%AbstractPickleTests.test_float_formatc C s6 t D ],}t� }| �||�}| �|�}| �|t� qd S r )r� �AAAr� r� r� �REDUCE_A�r& r� �instr� r� r r r � test_reducej s
z AbstractPickleTests.test_reducec C s: t D ]0}tdd�}| �||�}| �|�}| �||� qd S )Nr r� )r� rX r� r� r� r r r r �test_getinitargsq s
z$AbstractPickleTests.test_getinitargsc C s: t � }tD ]*}| �||�}| �|�}| �|j|j� q
d S r )r] r� r� r� r� rs �r& rZ r� r� r[ r r r �test_metaclassx s
z"AbstractPickleTests.test_metaclassc C s^ t dtf�}t�ttj� tD ]:}| �||�}| �|�}| � ||� | �
t |�t |�� q d S )NZmy_dynamic_class) ra r� r= r r^ rS r� r� r� r� r� r_ r r r r �test_dynamic_class s
z&AbstractPickleTests.test_dynamic_classc C s� dd l }dd l}|�� }tD ]�}| �||�}| �|�}| �||� |�|j�}| �||�}| �|�}| �||� t |d�r |�
|j�}| �||�}| �|�}| �||� q d S )Nr �statvfs) �timert � localtimer� r� r� r� �stat�curdirr� r )r& r rt rn r� r� r� r r r �test_structseq� s
z"AbstractPickleTests.test_structseqc C s0 t D ]&}| �d|�}| �|�}| �d|� qd S �N.)r� r� r� r� �r& r� r� r� r r r �
test_ellipsis� s
z!AbstractPickleTests.test_ellipsisc C s0 t D ]&}| �t|�}| �|�}| �t|� qd S r )r� r� r� r� r� r r r r �test_notimplemented� s
z'AbstractPickleTests.test_notimplementedc C sL d dt g}|D ]8}tD ].}| �t|�|�}| �|�}| �t|�|� qqd S r )r� r� r� r_ r� r� )r& Z
singletonsZ singletonr� r� r� r r r �test_singleton_types� s
z(AbstractPickleTests.test_singleton_typesc
C s� t D ]N}| �d |�}|dkr>tjt|g� }| �|�|�� q| �ttj|�d� qt d d }tj tj
}tjt|g� | }z| � |� W n2 t k
r� } z| �
dt|�� W 5 d }~X Y n X | �d� d S )Nr� r r� r zunsupported pickle protocolz0expected bad protocol number to raise ValueError)r� r� r �PROTOrl r� �
startswithr� r �NONEr� r� r� r� rW Zfail)r& r� r
Z proto_headerZoobZ
build_noneZ badpickle�errr r r �
test_proto� s "z AbstractPickleTests.test_protoc C sL d}t D ]>}| �||�}| �|�}| �||� | �ttj|�|dk� qd S )N� �UJ^w,3�| r� )r� r� r� r� r� r r �LONG1�r& r! r� r� r� r r r �
test_long1� s
z AbstractPickleTests.test_long1c C sP dd> }t D ]>}| �||�}| �|�}| �||� | �ttj|�|dk� q d S )Nr r� r� )r� r� r� r� r� r r �LONG4r r r r �
test_long4� s
z AbstractPickleTests.test_long4c C s� t jt jt jt jt jt jt jt jt jt jt jt jt jt jt jt jt jt jt jt jd�}d}d}d}d}d}tD ]`}|||||fD ]L}| �||�} | �| �}
| � ||
� |t
|d�t |�f } | � t
| | �� q�qnd S )N))r r )r r )r r� )r r )r r! )r r )r r �r r� )r r �r r! )r� r �r� r )r� r� )r� r )r� r! )r r )r r )r r� )r r �r r! r )r r! �r r� r )r r� r r! r )r �TUPLE� EMPTY_TUPLE�TUPLE1�TUPLE2�TUPLE3r� r� r� r� �minr� r� r ) r& �expected_opcoderZ r[ r� r� �er� r! r� r� r r r r �test_short_tuples� sB �
z%AbstractPickleTests.test_short_tuplesc
C s� t jt jt jt jt jt jt jt jt jt jt jt jd� }tD ]^}dD ]T}| �||�}| �|�}| �||k||||f� |t |d�|f }| �t
||�� qBq:d S )N) )r N)r N)r� N)r N)r T)r T)r� T)r T)r F)r F)r� F)r F)NFTr ) r r �INT�NEWTRUE�NEWFALSEr� r� r� r� r+ r )r& r, r� r! r� r� r r r r �test_singletons� s( �
z#AbstractPickleTests.test_singletonsc C sJ t dddg�}d|_d|_tD ]&}| �||�}| �|�}| �||� q d S �Nr r� r r �hello)r� r� r� r� r� r� r� r r r r �test_newobj_tuple s
z%AbstractPickleTests.test_newobj_tuplec C sJ t dddg�}d|_d|_tD ]&}| �||�}| �|�}| �||� q d S r3 )r� r� r� r� r� r� r� r r r r �test_newobj_list s
z$AbstractPickleTests.test_newobj_listc C s� t D ]�}tD ]x}|j}||j�}d|_| �||�}| �|�}|||||t|�f}| �||� | � ||�||�|� | � |j
|j
|� q qd S �Nr ) r� � myclasses�__base__�sampler� r� r� r_ r� r� rE )r& r� rD �Br! r� r� �detailr r r �test_newobj_generic' s
z'AbstractPickleTests.test_newobj_genericc C s� t d d � }ttfD ]}|�|� qtD ]�}|D ]�}|j}||j�}d|_t� |�}| �
||�}| � |�} | � t
| �t
|�� ||||| t
| �f}
| � ||�|| �|
� | � |j| j|
� q0q(d S r7 )r8 �MyIntr� r{ r� r9 r: r� �weakref�proxyr� r� r� r_ rE ) r& �classesr� r� rD r; r! r r� r� r< r r r �test_newobj_proxies4 s
z'AbstractPickleTests.test_newobj_proxiesc C sD t }t �t �}| �|d�}z da | �ttjf| j|� W 5 |a X d S )Nr! r )� SimpleNewObjr� r� r� r* r r� r� )r& �saver� r[ r r r �test_newobj_not_classG s
z)AbstractPickleTests.test_newobj_not_classc C s� t |�}z�t�td|� tdddg�}d|_d|_| �|d�}| � t�
d�|� | � d|� | � t ||�� | �
|�}| �||� | �|d�}| �t�
d�|� | �d|� | �t ||�d t|�� | �
|�}| �||� W 5 |�� X d S )
Nr� r r� r r r4 rg s MyListT)r; rC r= rB r0 r� r� r� r� r� r� � assertFalser r� r� r� r� �repr)r& Zextcode�opcoder- r! �s1r� �s2r r r �produce_global_extW s&
z&AbstractPickleTests.produce_global_extc C s | � dtj� | � dtj� d S )Nr r� )rK r �EXT1r) r r r �test_global_ext1s s z$AbstractPickleTests.test_global_ext1c C s. | � dtj� | � dtj� | � dtj� d S )Nr� r� iͫ )rK r �EXT2r) r r r �test_global_ext2w s z$AbstractPickleTests.test_global_ext2c C s. | � dtj� | � dtj� | � dtj� d S )N� r� i�ͫ)rK r �EXT4r) r r r �test_global_ext4| s z$AbstractPickleTests.test_global_ext4c C s� d}t t|��}tD ]B}| �||�}| �|�}| �||� ttj|�}| � ||dk� qd}t t|��}tD ]V}| �||�}| �|�}| �||� ttj|�}|dkr�| � |d� ql| �
|dk� qld S �N�
r �� r� ) r� r� r� r� r� r� r r �APPENDSr� r� )r& r r! r� r� r� Z num_appendsr r r �test_list_chunking� s$
z&AbstractPickleTests.test_list_chunkingc C s� d}t �t|��}tD ]N}| �||�}| �|t� | �|�}| �||� t t
j |�}| � ||dk� qd}t �t|��}tD ]V}| �||�}| �|�}| �||� t t
j |�}|dkr�| � |d� q|| �
|dk� q|d S rS )rb r� r� r� r� r� r r� r� r r �SETITEMSr� r� )r& r r! r� r� r� Z num_setitemsr r r �test_dict_chunking� s&
z&AbstractPickleTests.test_dict_chunkingc C s� d}t t|��}tD ]T}| �||�}| �|�}| �||� ttj|�}|dk r\| � |d� q| � |d� qd}t t|��}tD ]T}| �||�}| �|�}| �||� ttj|�}|dk r�| � |d� q~| �
|d� q~d S )NrT r! r r rU r� ) r� r� r� r� r� r� r r �ADDITEMSr� �assertGreaterEqual)r& r r! r� r� r� Z num_additemsr r r �test_set_chunking� s(
z%AbstractPickleTests.test_set_chunkingc
C s� t �t d�}d|_tD ]�}| j|d��t | �||�}|dk rJ| �d|� n | �d|� | �tt j
|�d|k� | � tt j |�� | �
|�}| �||� W 5 Q R X qd S )N�� � �r� r �
I64206� M�r� )rC r� r� r� r� r� r� r� r r �NEWOBJrF � NEWOBJ_EXr� r� r r r r �test_simple_newobj� s �
z&AbstractPickleTests.test_simple_newobjc
C s� t �t d�}d|_tD ]�}| j|d��� | �||�}|dk rJ| �d|� n8|dk r`| �d|� n"|dk rv| �d |� n | �d
|� | �tt j
|�d|k� | � tt j |�� | �
|�}| �||� W 5 Q R X qd S � Nr] r^ r_ r r` r� ra r! s X FACEs �FACE)�
ComplexNewObjr� r� r� r� r� r� r� r r rb rF rc r� r� r r r r �test_complex_newobj� s$ �
z'AbstractPickleTests.test_complex_newobjc
C s� t �t d�}d|_tD ]�}| j|d��� | �||�}|dk rJ| �d|� n8|dk r`| �d|� n"|dk rv| �d |� n | �d
|� | �tt j
|�� | � tt j |�d|k� | �
|�}| �||� W 5 Q R X qd S re )�ComplexNewObjExr� r� r� r� r� r� rF r r rb r� rc r� r� r r r r �test_complex_newobj_ex� s$ �
z*AbstractPickleTests.test_complex_newobj_exc C s@ t dddg�}d|_d|_| �|d�}| �|�}| �||� d S r3 )�SlotListr� r� r� r� r� )r& r! r� r� r r r �test_newobj_list_slots� s
z*AbstractPickleTests.test_newobj_list_slotsc C sT t D ]J}t� }| �|jd� | �||�}| �|jd� | �|�}| �|jd� qd S r< )r� �REX_oner� �_reduce_calledr� r� r� r r r �'test_reduce_overrides_default_reduce_ex s
z;AbstractPickleTests.test_reduce_overrides_default_reduce_exc C sT t D ]J}t� }| �|jd � | �||�}| �|j|� | �|�}| �|jd � qd S r )r� �REX_twor� �_protor� r� r� r r r �test_reduce_ex_called s
z)AbstractPickleTests.test_reduce_ex_calledc C sT t D ]J}t� }| �|jd � | �||�}| �|j|� | �|�}| �|jd � qd S r )r� � REX_threer� rp r� r� r� r r r � test_reduce_ex_overrides_reduce s
z3AbstractPickleTests.test_reduce_ex_overrides_reducec C sT t D ]J}t� }| �|jd � | �||�}| �|j|� | �|�}| �|j|� qd S r )r� �REX_fourr� rp r� r� r� r r r �test_reduce_ex_calls_base" s
z-AbstractPickleTests.test_reduce_ex_calls_basec C sT t D ]J}t� }| �|jd� | �||�}| �|jd� | �|�}| �|jd� qd S r< )r� �REX_fiver� rm r� r� r� r r r �test_reduce_calls_base+ s
z*AbstractPickleTests.test_reduce_calls_basec C s& t � }tD ]}| �t| j||� q
d S r )�
BadGetattrr� r� � RuntimeErrorr� )r& r! r� r r r �test_bad_getattr4 s z$AbstractPickleTests.test_bad_getattrc C s� G dd� dt �}G dd� dt �}tD ]X}z| �|� |� W n tjk
rP Y nX z| �|� |� W q$ tjk
rz Y q$X q$d S )Nc @ s e Zd Zdd� ZdS )z7AbstractPickleTests.test_reduce_bad_iterator.<locals>.Cc S s t dd g d fS rM )r� r) r r r rS ? s zBAbstractPickleTests.test_reduce_bad_iterator.<locals>.C.__reduce__N�r0 r1 r2 rS r r r r rD > s rD c @ s e Zd Zdd� ZdS )z7AbstractPickleTests.test_reduce_bad_iterator.<locals>.Dc S s t dd d g fS rM )rb r) r r r rS C s zBAbstractPickleTests.test_reduce_bad_iterator.<locals>.D.__reduce__Nr{ r r r r rI B s rI )r� r� r� r �
PicklingError)r& rD rI r� r r r �test_reduce_bad_iterator; s z,AbstractPickleTests.test_reduce_bad_iteratorc
C s� dd� t d�D �}tdd� |D ��}t|�t|�t|�g}tD ]>}| j|d��( | �||�}| �|�}| �||� W 5 Q R X q>d S )Nc s s | ]}d t |� V qdS )ZaaaNrV r� r r r � <genexpr>U s z>AbstractPickleTests.test_many_puts_and_gets.<locals>.<genexpr>r c s s | ]}|d ddgfV qdS )r! rh r" Nr )rr �kr r r r~ V s r_ )r� rb r� r� r� r� r� )r& r� Z
large_dictrw r� r� r� r r r �test_many_puts_and_getsR s
z+AbstractPickleTests.test_many_puts_and_getsc C sj t D ]`}t� }d|_d|_| �||�}| �|�}t|j�}t|j�}t||�D ]\}}| � ||� qNqd S )Nr r4 )
r� rD r� r� r� r� �sortedrE �zipr� ) r& r� r! r� r� Zx_keysZy_keysZx_keyZy_keyr r r � test_attribute_name_interning_ s
z1AbstractPickleTests.test_attribute_name_interningc C s> | � td�d�}| �|t� | � tdg�d�}| �|t� d S )Nrh r� r )r� r� r� r� r� � DATA_SET2r� r r r �test_pickle_to_2xm s z%AbstractPickleTests.test_pickle_to_2xc C sT t D ]J}dtdd tf}| �||�}| �|�}| �t|�t|�� | �||� qd S )Nr s xyi x )r� r+ r� r� r� r� )r& r� r� r� r� r r r �test_large_picklesw s
z&AbstractPickleTests.test_large_picklesc
s� t D ]v� �j� d��` � �fdd�td�D �}ttt|��}��t|�|� � dkrp|D ]}��t t
j |�� qXW 5 Q R X qd S )Nr_ c s g | ]}�� d | � ��qS �r� �r� )rr r �r� r& r r rs � s zDAbstractPickleTests.test_int_pickling_efficiency.<locals>.<listcomp>�F r� ) r� r� r� r� �mapr� r� r� rF r r �LONG)r& ZpicklesZsizesr r r� r � test_int_pickling_efficiency� s z0AbstractPickleTests.test_int_pickling_efficiencyc C s6 | � ||�}| �t||�� | �|�}| �||� d S r )r� r� r r� r� )r& rw rH r� r
r r r r �_check_pickling_with_opcode� s
z/AbstractPickleTests._check_pickling_with_opcodec C sF t dddg�}tD ].}|dkr0| �|tj|� q| �|tj|� qd S )Nr r� r r )r� r� r� r �APPENDrV �r& rw r� r r r �test_appends_on_non_lists� s
z-AbstractPickleTests.test_appends_on_non_listsc C sH t dddd��}tD ].}|dkr2| �|tj|� q| �|tj|� qd S )Nr� ������r% r )r� r� r� r �SETITEMrX r� r r r �test_setitems_on_non_dicts� s
z.AbstractPickleTests.test_setitems_on_non_dictsr! rP c C s< d }}dddddh}t �|�D ]�\}}}|dk rJ| �||� ||krJd}|dk r~| �|jd� |j|kr�| �t|�| j� nX|jdks�|j|kr�t|�| jkr�|dk r�| �|| | j� d}n|dkr�|jdkr�|}|jdkr | � || j� |d | }q t|�}|dk �r | �
||� n |dk �r8| �|| | j� dS )
a
Check the arguments of FRAME opcodes in a protocol 4+ pickle.
Note that binary objects that are larger than FRAME_SIZE_TARGET are not
framed by default and are therefore considered a frame by themselves in
the following consistency check.
N�BINBYTES�
BINUNICODE� BINBYTES8� BINUNICODE8r� �FRAMEr � ) r r �assertLessEqual�assertNotEqualrc r� �FRAME_SIZE_TARGET�
assertLess�FRAME_SIZE_MINr[ r� )r& r
Z frame_endZframeless_startZframeless_opcodesr rJ �posr r r �check_frame_opcodes� sD �
� �
�
z'AbstractPickleTests.check_frame_opcodesc
C s� t td��}tdtjd �D ]�}| j|d��j | �||�}| �|�}| �||� t|�t tj
|� }| � || j d � | �
|| j d � | �|� W 5 Q R X q d S )Ni�� r! r r_ r� )r� r� r r� r� r� r� r� r� r r� �
assertGreaterr� r� r� )r& rw r� r
r Zbytes_per_framer r r �test_framing_many_objects� s
���z-AbstractPickleTests.test_framing_many_objectsc C s d}dd� t d�D �}d| f|d| d| f�}t dtjd �D ]�}d
D ]�}| j||d ��� |sp| �||�}nDt| d �s�W 5 Q R � qJt�� }| j||d
�}||_ |�
|� |� � }| � |�} | �
dd� |D �dd� | D �� | �
|| � ttj|�}
| �
|
d � | �|� W 5 Q R X qJqBd S )Ni c S s g | ]
}|g�qS r r r� r r r rs � s zBAbstractPickleTests.test_framing_large_objects.<locals>.<listcomp>rT � x� y�zr! r )FT)r� �fast�pickler�rn c S s g | ] }t |��qS r �r� rq r r r rs � s c S s g | ] }t |��qS r r� rq r r r rs � s )r� r r� r� r� r� r, r4 r� r� �dumpr5 r� r� r r� r� ) r& �NZ small_itemsrw r� r� r
�bufr� r �n_framesr r r �test_framing_large_objects� s.
� z.AbstractPickleTests.test_framing_large_objectsc s� t jdk rd S d dd�}| j�d}ttfD ]�� � �fdd�t|�D �}tdt jd �D ]z}| �||�}||�}| �tt j |�d� | �|| �
|�� ||d d
� �}| � tt j |�tt j |�� | �|| �
|�� qVq*d S ) Nr! c
S s� g }d}t �| �D ] \}}}|jdkr|�|� qt� }d}t|�D ].\} }|rZ|| �rZqD|| ||� 7 }|| }qD|| |d� 7 }|S )z+Remove frame opcodes from the given pickle.r� r� r N)r r rc r� r � enumerate)
r
Z
keep_frameZ frame_startsZframe_opcode_sizerH �_r� Z newpickleZlast_frame_endr� r r r �
remove_frames
s
z?AbstractPickleTests.test_optional_frames.<locals>.remove_frames� c s i | ]}|� |g�� �qS r r r� �Z
bytes_type�
frame_sizer r �
<dictcomp>$
s z<AbstractPickleTests.test_optional_frames.<locals>.<dictcomp>r r c S s | d S )Nr� r )r� r r r r� -
rK z:AbstractPickleTests.test_optional_frames.<locals>.<lambda>)N) r r� r� rl r r� r� r� r r� r� r� )r& r� Z
num_framesrw r� r
Zframeless_pickleZsome_frames_pickler r� r �test_optional_frames
s"
�z(AbstractPickleTests.test_optional_framesc
s� G dd� d�}t dtjd �D �]Z}dd� t td��D �}|�d� jd d � |� }� �||��|� |�� }� � |�}� �
||� � � t |j
�d� ~t�� � �
|�� |� t |�d � j d }� �t |j
�|� � �t |j
�d
| d � d d� |j
D �}� fd
d�|D �} � fdd�|D �}
dd� |D �} | D ]} � �| d
� j |� �q<� �t | �t | �t |
� d |� q d S )Nc @ s( e Zd ZdZdd� Zdd� Zdd� ZdS ) zYAbstractPickleTests.test_framed_write_sizes_with_delayed_writer.<locals>.ChunkAccumulatorz2Accumulate pickler output in a list of raw chunks.c S s
g | _ d S r )�chunksr) r r r r9 6
s zbAbstractPickleTests.test_framed_write_sizes_with_delayed_writer.<locals>.ChunkAccumulator.__init__c S s | j �|� d S r )r� r� )r& �chunkr r r r8 8
s z_AbstractPickleTests.test_framed_write_sizes_with_delayed_writer.<locals>.ChunkAccumulator.writec S s d� | j�S )NrK )r} r� r) r r r �concatenate_chunks:
s zlAbstractPickleTests.test_framed_write_sizes_with_delayed_writer.<locals>.ChunkAccumulator.concatenate_chunksN)r0 r1 r2 r: r9 r8 r� r r r r �ChunkAccumulator4
s r� r! r c S s, g | ]$}t |��d �|d dt |�if�qS )r� r r� )rW r� r� r r r rs >
s �zSAbstractPickleTests.test_framed_write_sizes_with_delayed_writer.<locals>.<listcomp>g ��@Z0123456789abcdefr� r� r c S s g | ] }t |��qS r r� )rr r� r r r rs b
s c s g | ]}|� j kr|�qS r �r� �rr r� r) r r rs c
s
�c s* g | ]"}d | k r � j k rn q|�qS �r� r� r� r) r r rs e
s
�c S s g | ]}|d kr|�qS r� r r� r r r rs g
s )r� r r� r� r� r� r� r� r� r� r� r� r� r� r �
gc_collectr[ r� r� )
r& r� r� Zobjects�writerr
Z
reconstructedr� Z chunk_sizesZ large_sizesZ medium_sizesZ small_sizesZ
chunk_sizer r) r �+test_framed_write_sizes_with_delayed_writer2
s@
� �
�
�z?AbstractPickleTests.test_framed_write_sizes_with_delayed_writerc C sz G dd� d�a ttjd �D ]X}t jt jjt jjjfD ]<}| j||d��$ | �| � ||��}| �
||� W 5 Q R X q6q d S )Nc @ s e Zd ZG dd� d�ZdS )�Nestedc @ s e Zd ZG dd� d�ZdS )zNested.Ac @ s e Zd ZG dd� d�ZdS )z
Nested.A.Bc @ s e Zd ZdS )z Nested.A.B.CNrP r r r r rD y
s rD N)r0 r1 r2 rD r r r r r; x
s r; N)r0 r1 r2 r; r r r r �Aw
s r� N)r0 r1 r2 r� r r r r r� v
s r� r )r� rw ) r� r� r r� r� r; rD r� r� r� r� )r& r� rw r r r r �test_nested_namest
s z%AbstractPickleTests.test_nested_namesc
C st G dd� d�a tjt j t _dt _ttjd �D ]:}| j |d��$ | �
| � t |��}| � |t � W 5 Q R X q0t `d S )Nc @ s e Zd ZdS )� RecursiveNrP r r r r r� �
s r� zRecursive.mod.Recursiver r_ )
r� rx �modulesr1 �modr2 r� r r� r� r� r� r� )r& r� r r r r �test_recursive_nested_names�
s z/AbstractPickleTests.test_recursive_nested_namesc C s� G dd� d�a t jt jt � jt jjt jjt �� jf}t jt ft jjt jff}tt j
d �D ]�}|D ]@}| j ||d��( | � | �
||��}| �|� |� � W 5 Q R X qb|D ]N\}}|� }| j ||d��, | � | �
||��}| �||�||�� W 5 Q R X q�qZd S )Nc @ s: e Zd Zedd� �Zedd� �Zdd� ZG dd� d�Zd S )
�
PyMethodsTestc S s dS )N�cheeser r r r r r� �
s zPyMethodsTest.cheesec S s | t ks t�dS )N�wine)r� �AssertionError�ry r r r r� �
s zPyMethodsTest.winec S s t | t�st�dS )N�biscuits)r� r� r� r) r r r r� �
s zPyMethodsTest.biscuitsc @ s0 e Zd ZdZedd� �Zedd� �Zdd� ZdS ) zPyMethodsTest.Nestedz Nested classc S s dS )N�ketchupr r r r r r� �
s z PyMethodsTest.Nested.ketchupc S s | t jkst�dS )N�maple)r� r� r� r� r r r r� �
s zPyMethodsTest.Nested.maplec S s t | tj�st�dS )N�pie)r� r� r� r� r) r r r r� �
s zPyMethodsTest.Nested.pieN) r0 r1 r2 r: � staticmethodr� r� r� r� r r r r r� �
s
r� N) r0 r1 r2 r� r� r� r� r� r� r r r r r� �
s
r� r �r� �method)r� r� r� r� r� r� r� r� r� r r� r� r� r� r� )r& Z
py_methodsZpy_unbound_methodsr� r� r ry rw r r r �test_py_methods�
s* � � z#AbstractPickleTests.test_py_methodsc C s G dd� dt �adjdftjdfdddgjd ftjdddgffddhjd
ftjddhdfftj d ft
j d ftdddg�j d
ftj tdddg�dfft�
d
�j dftj
j t�
d
�dfff }ttjd �D ]R}|D ]H\}}| j||d��, | �| �||��}| �||� ||� � W 5 Q R X q�q�d S )Nc @ s e Zd ZG dd� de�ZdS )�Subclassc @ s e Zd ZdS )zSubclass.NestedNrP r r r r r� �
s r� N)r0 r1 r2 rW r� r r r r r� �
s r� �abcd)r� )r� r� r r� r r r� ))rZ r )r[ r� )s abcr� Zsweet)r- r- r� )r� r� �indexrW �__len__r� � __contains__r� rb r� r � maketrans�countr� r� r r� r� r� r� r� )r& Z c_methodsr� r� r' r r r r �test_c_methods�
s& � z"AbstractPickleTests.test_c_methodsc C s� t dd�ddfttd�ddftjddftjd d ft� d
d ft� � d d
ft�
� ddft� � ddfg}|D ]t\}}}t d�D ]`}| j t
|�|d��D | �||�}| �d||f �� |� | �t
| �|��t
|�� W 5 Q R X qxqfd S )Nr r � __builtin__�xrangeZ123� itertools�imapr$ r& �
exceptionsr� r( �IterableUserDict�UserListr' � defaultdictr )r_ r� zc%s
%s)r� r� r� r# r$ r% r& r� r' r( r� r� r� r_ r� r� r� r� r� )r& Ztests�valr� rc r� r
r r r �test_compat_pickle�
s
�
z&AbstractPickleTests.test_compat_picklec
C s� dd� }t dtjd �D ]2}| �ttjf�� t�| �||�� W 5 Q R X q|` t dtjd �D ]2}| �ttjf�� t�| �||�� W 5 Q R X q`|j
|_ t dtjd �D ]2}| �ttjf�� t�| �||�� W 5 Q R X q�d S )Nc S s d S r r r r r r r� �
s z6AbstractPickleTests.test_local_lookup_error.<locals>.fr r ) r� r r� r� �AttributeErrorr| r r� r� r1 r2 r0 �r& r� r� r r r �test_local_lookup_error�
s z+AbstractPickleTests.test_local_lookup_errorc c s� d}t |�V t|�V td k r�t|�}tj|dd�}dtjfD ]>}t|dd|d�V t|ddd |d
�V t|ddd |d
�V q@d S ) N� abcdefgh�little)� byteorderr r; )r� )rr r� r� )r! r� r# )rr r� r� r� r" )rf r� r� r� r� �
from_bytesr� r� )r& Z
bytestringr� rR r� r r r �buffer_like_objects s&
� � �z'AbstractPickleTests.buffer_like_objectsc C s | � � D ]�}tdtjd �D ]�}| �||�}|jrF|dkrF| �d|� | �ttj |�d� |dkr�| �ttj
|�|j rzdnd� | �ttj |�|j r�dnd� dd� }| j|||d�}| �||� | �
|�}| �||� | �t|�t|�� | �||� q qd S )Nr r rh r� c S s dS �NTr �rw r r r �buffer_callback0 s zAAbstractPickleTests.test_in_band_buffers.<locals>.buffer_callback�r� )r� r� r r� r� r} r� r� r � NEXT_BUFFER�SHORT_BINBYTESr| r� r� r� r� r_ )r& rw r� r� r� �data2r� r r r �test_in_band_buffers s, � ��
z(AbstractPickleTests.test_in_band_buffersc s� | � � D �]�}tdd�D ],}| �t�� | j||g jd� W 5 Q R X qtdtjd �D �]R}g � � fdd�}| j|||d�}| �d|� | � t
tj |�d� | � t
tj |�d� | � t
tj
|�d� | � t
tj|�|jr�dnd� |jr�| � t� d �d� | �tj�� | �|� W 5 Q R X | j|� d�}|j�rB| �||� n | �t|�t|�� | � ||� | j|t� �d�}|j�r�| �||� qV| �t|�t|�� | � ||� qVqd S ) Nr rh r� r c s � � | �� �S r )r� r� )r� ��buffersr r r� I rK z6AbstractPickleTests.test_oob_buffers.<locals>.<lambda>r� r� )r� r� r� r� r� r� r r� r� r� r r� r� r� �READONLY_BUFFERr| r} rl r� r� r r� r_ �iter)r& rw r� r� r� r� r r� r �test_oob_buffers? sB � � � z$AbstractPickleTests.test_oob_buffersc C st t d�}tdtjd �D ]V}g }|j}| j|||d�}tt|�}| j||d�}| � t
|�t
|�� | � ||� qd S �N� foobarrh r r� r� ) rf r� r r� r� r� r� r r� r� r_ r� )r& rw r� r� r� r� r� r r r �%test_oob_buffers_writable_to_readonlyi s
z9AbstractPickleTests.test_oob_buffers_writable_to_readonlyc
C sB t �d�}tdd�D ](}| �t j�� | �||� W 5 Q R X qd S )Nr� r rh )r rk r� r� � PickleErrorr� )r& r� r� r r r �test_picklebuffer_errorv s
z+AbstractPickleTests.test_picklebuffer_errorc C s< dd� }t �d�}| �t�� | j|d|d� W 5 Q R X d S )Nc S s dd d S r� r r� r r r r� ~ s zGAbstractPickleTests.test_buffer_callback_error.<locals>.buffer_callbackr� rh r� )r rk r� �ZeroDivisionErrorr� )r& r� r� r r r �test_buffer_callback_error} s
z.AbstractPickleTests.test_buffer_callback_errorc
C s� t �d�}tdt jd �D ]b}| j||g jd�}| �t�� | j|t � d� W 5 Q R X | �t j
�� | j|g d� W 5 Q R X qd S r� ) r rk r� r� r� r� r� r* r� r� r� )r& r� r� r� r r r �test_buffers_error� s
z&AbstractPickleTests.test_buffers_errorc C s8 t dtjd �D ]"}| jd|d d�}| j|d d�}qd S )Nrh r r� r� )r� r r� r� r� )r& r� Z data_pickledr� r r r �+test_inband_accept_default_buffers_argument� s z?AbstractPickleTests.test_inband_accept_default_buffers_argumentNzTest needs Numpyc s� �fdd���fdd�� � ��fdd�}t �d�}||� ||d d d� � t �d ��d
�}||� ||j� ||d d d� � d S ) Nc s& t j�| |� � �| jj|jj� d S r )�np�testing� assert_equalr� �ctypesr� �r! r� r) r r �
check_no_copy� s z=AbstractPickleTests.test_buffers_numpy.<locals>.check_no_copyc s& t j�| |� � �| jj|jj� d S r )r r r r� r
r� r r) r r �
check_copy� s z:AbstractPickleTests.test_buffers_numpy.<locals>.check_copyc s� t dtjd �D ]$}��| |�}��|�}� | |� qt dtjd �D ]0}dd� }�j| ||d�}��|�}� | |� qFt dtjd �D ]R}g }|j}�j| ||d�}�j||d�}| jjs�| jjrЈ| |� q�� | |� q�d S )Nr r rh c S s dS r� r )r� r r r r� � rK zMAbstractPickleTests.test_buffers_numpy.<locals>.check_array.<locals>.<lambda>r� r� ) r� r r� r� r� r� r� r} r~ )�arrr� r� r� r� r� �r
r r& r r � check_array� s"
z;AbstractPickleTests.test_buffers_numpy.<locals>.check_arrayr" r� � r$ )r ZarangeZreshape�T)r& r r r r r �test_buffers_numpy� s
z&AbstractPickleTests.test_buffers_numpy)�r0 r1 r2 Z optimizedr� r� r� r� r� r� r� r" r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r r
r r r r r r r r. r2 r5 r6 r= rB rE rK rM rO rR rW rY r\ rd rg ri rk rn rq rs ru rw r rz r} r� r� r� r� r� r� r� r� r� r� r� r Zskip_if_pgo_taskr� r� r� r� r� r� r� r� r� r� r� r� r� r r r r r �unittestZskipIfr r r r r r r� � s�
'
/
*
A
1# *
r� c @ sz e Zd Zeeddd�dd� �Zeeddd�dd� �Zeeddd�d d
� �Zeed dd�d d
� �Z eed dd�dd� �Z
dS )�BigmemPickleTestsg������ @F)�sizeZmemuse�dry_runc C sp dd| > }zXt D ]N}|dk r q| j|d��. | �ttf�� | j||d� W 5 Q R X W 5 Q R X qW 5 d }X d S )Nr r� r� r_ r� )r� r� r� r� r� r� )r& r r� r� r r r �test_huge_long_32b� s (z$BigmemPickleTests.test_huge_long_32bg @c
C s� d|d }z�t D ]|}|dk r q| j|d��\ zN| j||d�}tjt�dt|�� }|�|�}| � |||t|� |� � W 5 d }X W 5 Q R X qW 5 d }X d S )N� abcdr! r r_ r� r� )
r� r� r� r r� r� r� r� r� r� �r& r r� r� r
�headerZ
data_startr r r �test_huge_bytes_32b� s$ �
�z%BigmemPickleTests.test_huge_bytes_32bc C s� d|d }z�t D ]�}|dk r q| j|d��� |dkrj| �ttf�� | j||d� W 5 Q R X W 5 Q R � qzN| j||d�}tjt� dt
|�� }|� |�}| � |||t
|� |� � W 5 d }X W 5 Q R X qW 5 d }X d S )Ns acbdr! r r_ r� �<Q)
r� r� r� r� r� r� r r� r� r� r� r� r� r r r r �test_huge_bytes_64b� s, �
�z%BigmemPickleTests.test_huge_bytes_64br� c
C s� d|d }z�t D ]�}|dkr q| j|d��� zv| j||d�}tjt�dt|�� }|�d�}| � |||t|� |� � | � |�
d�td� |�d� t|�� W 5 d }X W 5 Q R X qW 5 d }X d S )Nr� r! r r_ r� r� r ) r� r� r� r r� r� r� r� r� r� �rindexr r r r �test_huge_str_32b
s. �
���z#BigmemPickleTests.test_huge_str_32bc C s d|d }z�t D ]�}|dkr q| j|d��� |dk rj| �ttf�� | j||d� W 5 Q R X W 5 Q R � qzv| j||d�}tjt� dt
|�� }|� d�}| � |||t
|� |� � | � |�
d�t
d� |� d� t
|�� W 5 d }X W 5 Q R X qW 5 d }X d S )Nr� r! r r_ r� r r )r� r� r� r� r� r� r r� r� r� r� r� r� r r r r r �test_huge_str_64b% s6 �
���z#BigmemPickleTests.test_huge_str_64bN) r0 r1 r2 r r r r r
r r r! r r r r r � s
r c @ s e Zd ZdZdZdd� ZdS )rl z4No __reduce_ex__ here, but inheriting it from objectr c C s d| _ tdfS )Nr r )rm rl r) r r r rS F s zREX_one.__reduce__N�r0 r1 r2 r: rm rS r r r r rl C s rl c @ s e Zd ZdZdZdd� ZdS )ro z1No __reduce__ here, but inheriting it from objectNc C s || _ tdfS rM �rp ro �r& r� r r r ro M s zREX_two.__reduce_ex__�r0 r1 r2 r: rp ro r r r r ro J s ro c @ s e Zd ZdZdd� Zdd� ZdS )rr Nc C s || _ tdfS rM r# r$ r r r ro S s zREX_three.__reduce_ex__c C s t d��d S )Nz#This __reduce__ shouldn't be called)r r) r r r rS V s zREX_three.__reduce__)r0 r1 r2 rp ro rS r r r r rr Q s rr c @ s e Zd ZdZdZdd� ZdS )rt z(Calling base class method should succeedNc C s || _ t�| |�S r )rp r� ro r$ r r r ro \ s zREX_four.__reduce_ex__r% r r r r rt Y s rt c @ s e Zd ZdZdZdd� ZdS )rv z-This one used to fail with infinite recursionr c C s d| _ t�| �S r� )rm r� rS r) r r r rS c s zREX_five.__reduce__Nr" r r r r rv ` s rv c @ s2 e Zd ZdZd dd�Zdd� Zdd� Zd d
� ZdS ) r� z]This class is used to check the 4th argument (list iterator) of
the reduce protocol.
Nc C s |d k r |ng | _ d S r r� )r& r� r r r r9 k s zREX_six.__init__c C s t | �t |�ko| j|jkS r )r_ r� rF r r r rH m s zREX_six.__eq__c C s | j �|� d S r )r� r� )r& �itemr r r r� o s zREX_six.appendc C s t | �dd t| j�d fS rM )r_ r� r� r) r r r rS q s zREX_six.__reduce__)N)r0 r1 r2 r: r9 rH r� rS r r r r r� g s
r� c @ s2 e Zd ZdZd dd�Zdd� Zdd� Zd d
� ZdS ) r� z]This class is used to check the 5th argument (dict iterator) of
the reduce protocol.
Nc C s |d k r |ni | _ d S r r� )r& r� r r r r9 x s zREX_seven.__init__c C s t | �t |�ko| j|jkS r )r_ r� rF r r r rH z s zREX_seven.__eq__c C s || j |< d S r r� )r& r� rR r r r � __setitem__| s zREX_seven.__setitem__c C s t | �dd d t| j�� �fS rM )r_ r� r� r� r) r r r rS ~ s zREX_seven.__reduce__)N)r0 r1 r2 r: r9 rH r' rS r r r r r� t s
r� c @ s2 e Zd ZdZd dd�Zdd� Zdd� Zd d
� ZdS ) r� zUThis class is used to check the 3th argument (state) of
the reduce protocol.
Nc C s
|| _ d S r �r� �r& r� r r r r9 � s zREX_state.__init__c C s t | �t |�ko| j|jkS r �r_ r� rF r r r rH � s zREX_state.__eq__c C s
|| _ d S r r( r) r r r � __setstate__� s zREX_state.__setstate__c C s t | �d| jfS rM r* r) r r r rS � s zREX_state.__reduce__)N)r0 r1 r2 r: r9 rH r+ rS r r r r r� � s
r� c @ s e Zd ZdZdS )r> r N�r0 r1 r2 r: r r r r r> � s r> c @ s e Zd ZdZdS )�MyFloatg �?Nr, r r r r r- � s r- c @ s e Zd ZdZdS )� MyComplexy �? Nr, r r r r r. � s r. c @ s e Zd ZdZdS )�MyStrr4 Nr, r r r r r/ � s r/ c @ s e Zd ZdZdS )� MyUnicodeu hello ሴNr, r r r r r0 � s r0 c @ s e Zd ZdZdS )r� r% Nr, r r r r r� � s r� c @ s e Zd ZdddgZdS )r� r r� r Nr, r r r r r� � s r� c @ s e Zd Zddd�ZdS )r� r r� rY Nr, r r r r r� � s r� c @ s e Zd ZddhZdS )r� rZ r[ Nr, r r r r r� � s r� c @ s e Zd Zeddh�ZdS )r� rZ r[ N)r0 r1 r2 r� r: r r r r r� � s r� c @ s e Zd ZdgZdS )rj r� N)r0 r1 r2 r� r r r r rj � s rj c @ s e Zd Zdd� Zdd� ZdS )rC c O s t d��d S )Nz3SimpleNewObj.__init__() didn't expect to get called)r* r� r r r r9 � s zSimpleNewObj.__init__c C s t | �t |�ko| j|jkS r )r� rE rF r r r rH � s zSimpleNewObj.__eq__N)r0 r1 r2 r9 rH r r r r rC � s rC c @ s e Zd Zdd� ZdS )rf c C s d| dfS )N�%Xr� r r) r r r �__getnewargs__� s z ComplexNewObj.__getnewargs__N)r0 r1 r2 r2 r r r r rf � s rf c @ s e Zd Zdd� ZdS )rh c C s d| fddifS )Nr1 �baser� r r) r r r �__getnewargs_ex__� s z!ComplexNewObjEx.__getnewargs_ex__N)r0 r1 r2 r4 r r r r rh � s rh c @ s e Zd Zdd� ZdS )rx c C s
| j d S r )r� )r& r� r r r � __getattr__� s zBadGetattr.__getattr__N)r0 r1 r2 r5 r r r r rx � s rx c @ sd e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd d � Zd
d� Z dd� Z
dd� Z dd� Z dd� Z
dS )�AbstractPickleModuleTestsc C s: t td�}z |�� | �t| jd|� W 5 t�t� X d S �Nrf �{ �r| r r �unlink�closer� r� r� �r& r� r r r �test_dump_closed_file� s
z/AbstractPickleModuleTests.test_dump_closed_filec C s: t td�}z |�� | �t| jd|� W 5 t�t� X d S r7 r9 r< r r r �test_load_closed_file� s
z/AbstractPickleModuleTests.test_load_closed_filec C sB t �� }di dg}| �||� |�d� | �|�}| �||� d S )Nr8 �| r )r, r4 r� r. �loadr� )r& �streamr� r r r r � test_load_from_and_dump_to_file� s
z9AbstractPickleModuleTests.test_load_from_and_dump_to_filec C s | � tjd� d S rg )r� r r� r) r r r �test_highest_protocol� s z/AbstractPickleModuleTests.test_highest_protocolc C s^ t �� }| �d|d� | jd|dd� | �dd� | jddd� | �|d� | j|dd� d S )Nr8 r� )�filern r� )r, r4 r� r� �Picklerr< r r r � test_callapi� s z&AbstractPickleModuleTests.test_callapic C sF t td�}z"tD ]}| �t| jd||� qW 5 |�� t�t� X d S )N�wr8 ) r| r r; r r: r� r� r* r� r� r r r �test_dump_text_file� s
z-AbstractPickleModuleTests.test_dump_text_filec C s( t �d�}| �ttjtjf| j|� d S )Ns X''.) r, r4 r� rd r� r. r r� r@ )r& r� r r r �test_incomplete_input� s
z/AbstractPickleModuleTests.test_incomplete_inputc C sN G dd� d| j �}G dd� d| j�}| �tj|� jd� | �tj|� j� d S )Nc @ s e Zd Zdd� ZdS )z;AbstractPickleModuleTests.test_bad_init.<locals>.BadPicklerc S s d S r r r) r r r r9
rK zDAbstractPickleModuleTests.test_bad_init.<locals>.BadPickler.__init__NrK r r r r �
BadPickler
s rJ c @ s e Zd Zdd� ZdS )z=AbstractPickleModuleTests.test_bad_init.<locals>.BadUnpicklerc S s d S r r r) r r r r9
rK zFAbstractPickleModuleTests.test_bad_init.<locals>.BadUnpickler.__init__NrK r r r r � BadUnpickler
s rK r )rE � Unpicklerr� r r| r� r� r@ )r& rJ rK r r r �
test_bad_init
s z'AbstractPickleModuleTests.test_bad_initc
C s� t d�}tdd�D ]*}| �t�� |||g jd� W 5 Q R X qtdtjd �D ]t}g }|j}||||d�}| �d|� | �t |d �d� | �tj
�� ||� W 5 Q R X |||d�}| � ||� qNd S )Ns foor rh )rn r� r r� ) rf r� r� r� r� r r� r� r� rl r� r� ) r& r� r� rw r� r� r� r� r� r r r � check_dumps_loads_oob_buffers
s$ �� z7AbstractPickleModuleTests.check_dumps_loads_oob_buffersc C s | � | j| j� d S r )rN r� r� r) r r r � test_dumps_loads_oob_buffers%
s z6AbstractPickleModuleTests.test_dumps_loads_oob_buffersc s( � fdd�}� fdd�}� � ||� d S )Nc s t �� }� j| |f|� |�� S r )r, r4 r� r5 )rw r� r� r) r r r� +
s zCAbstractPickleModuleTests.test_dump_load_oob_buffers.<locals>.dumpsc s t �| �}� j|f|�S r )r, r4 r@ )r� r� r� r) r r r� 0
s
zCAbstractPickleModuleTests.test_dump_load_oob_buffers.<locals>.loads)rN )r& r� r� r r) r �test_dump_load_oob_buffers)
s z4AbstractPickleModuleTests.test_dump_load_oob_buffersN)r0 r1 r2 r= r> rB rC rF rH rI rM rN rO rP r r r r r6 � s
r6 c @ s$ e Zd Zdd� Zdd� Zdd� ZdS )� AbstractPersistentPicklerTestsc C sN t |t�r,|d dkr,| jd7 _t|�S |dkrF| jd7 _dS d S d S )Nr� r r �test_false_valuer� )r� r� �id_countrW � false_count)r& r� r r r �
persistent_id=
s z,AbstractPersistentPicklerTests.persistent_idc C sD |s| j d7 _ dS | jd7 _t|�}|d dks<t�|S d S )Nr rR r� r )�load_false_count�
load_countr� r� )r& Zoidr� r r r �persistent_loadG
s z.AbstractPersistentPicklerTests.persistent_loadc C s� t td��dg }tD ]n}d| _d| _d| _d| _| �| �| � ||��|� | �| jd� | �| jd� | �| jd� | �| jd� qd S )NrT rR r rh r )
r� r� r� rS rT rV rW r� r� r� )r& �Lr� r r r �test_persistenceQ
s z/AbstractPersistentPicklerTests.test_persistenceN)r0 r1 r2 rU rX rZ r r r r rQ 7
s
rQ c @ s4 e Zd Zdd� Zdd� Zdd� Zdd� Zd d
� Zd S ) �&AbstractIdentityPersistentPicklerTestsc C s |S r r )r& rw r r r rU a
s z4AbstractIdentityPersistentPicklerTests.persistent_idc C s |S r r )r& �pidr r r rX d
s z6AbstractIdentityPersistentPicklerTests.persistent_loadc C s2 | � | �||��}| �|t|�� | �||� d S r )r� r� r� r_ r� )r& rw r� r r r r �_check_return_correct_typeg
s zAAbstractIdentityPersistentPicklerTests._check_return_correct_typec C sD t D ]:}|dkr | �dd� qddddtfD ]}| �||� q,qd S )Nr r� s abc
zabc
r� g*\��(��)r� r] rW )r& r� rw r r r �test_return_correct_typel
s
z?AbstractIdentityPersistentPicklerTests.test_return_correct_typec C sB d}| � tj| j|d� tj|�d� d }| � tj| j|� d S )Nu ∅r rg r� )r� r r| r� �PERSIDr� r� r� )r& Z
non_ascii_strr
r r r � test_protocol0_is_ascii_onlyu
s zCAbstractIdentityPersistentPicklerTests.test_protocol0_is_ascii_onlyN)r0 r1 r2 rU rX r] r^ r` r r r r r[ _
s
r[ c @ sj e Zd ZdZdZdd� Zdd� Zdd� Zdd � Zd
d � Z d d
�dd�Z
dd� Z dd� Z dd� Z
dd� ZdS )�#AbstractPicklerUnpicklerObjectTestsNc C s | j s
t�| jst�d S r )�
pickler_classr� �unpickler_classr) r r r r� �
s
z)AbstractPicklerUnpicklerObjectTests.setUpc C s� dddg}t D ]�}t�� }| �||�}|�|� |�� }|�d� |�� |�|� |�� }|�� |�d� |�� |�|� |�� }| � ||� | �
||� qd S �N�abcdefg�, r ) r� r, r4 rb r� r5 r. �truncate�
clear_memor� r� )r& r� r� r� r� �
first_pickledZsecond_pickledZ
third_pickledr r r �test_clear_pickler_memo�
s"
z;AbstractPicklerUnpicklerObjectTests.test_clear_pickler_memoc C sj dddg}t �� }| �|�}|�|� |�� }t �� }| �|�}|j|_|�|� |�� }| �||� d S �Nre rf )r, r4 rb r� r5 �memor� )r& r� r� r� ri �primed�primed_pickledr r r �test_priming_pickler_memo�
s
z=AbstractPicklerUnpicklerObjectTests.test_priming_pickler_memoc
C s� dddg}t �� }| �|�}|�|� |�� }t �� }| �|�}|j|_|�|� |�� }| �t �|��}|�� }| �||� | �t �|��}|j|_|�� } |j� � | �| |� | �
| |k� d S rk ) r, r4 rb r� r5 rl rc r@ r� �clearr� )
r& r� r� r� ri rm rn � unpicklerZunpickled_data1Zunpickled_data2r r r �test_priming_unpickler_memo�
s&
z?AbstractPicklerUnpicklerObjectTests.test_priming_unpickler_memoc C s� dddg}t �� }| �|�}|�|� |�� }dddg}t �� }| �|�}|�|� |�� }t �� }|�|� |�d� | �|�}| �|� � |� |�d� |�
� |�|� |�d� | �|� � |� d S rd ) r, r4 rb r� r5 r8 r. rc r� r@ rg )r& �data1r� r� Zpickled1r� Zpickled2rq r r r � test_reusing_unpickler_objects�
s(
zBAbstractPicklerUnpicklerObjectTests.test_reusing_unpickler_objectsT�r* c
C s� t D ]�}| j|d��� dd� td�D �dtg }|� }| j||d�}|�|� |�� }d}||| �}| �|�} t|�D ]<}
|r�|�� } | � | �
� |� |rx| � |�� | t|� � qx| � t | j
� W 5 Q R X qd S )Nr_ c S s g | ]}|t |�f�qS r rV rq r r r rs �
s zSAbstractPicklerUnpicklerObjectTests._check_multiple_unpicklings.<locals>.<listcomp>i� s abcder� rh )
r� r� r� r� rb r� r5 rc r/ r� r@ r� rd ) r& Zioclassr* r� rs r� r� r
r� rq r� r� r r r �_check_multiple_unpicklings�
s"
z?AbstractPicklerUnpicklerObjectTests._check_multiple_unpicklingsc C s | � tj� d S r )rv r, r4 r) r r r �"test_multiple_unpicklings_seekable s zFAbstractPicklerUnpicklerObjectTests.test_multiple_unpicklings_seekablec C s | j tdd� d S �NFru )rv r# r) r r r �$test_multiple_unpicklings_unseekable s zHAbstractPicklerUnpicklerObjectTests.test_multiple_unpicklings_unseekablec C s | j tdd� d S rx )rv r3 r) r r r �!test_multiple_unpicklings_minimal s zEAbstractPicklerUnpicklerObjectTests.test_multiple_unpicklings_minimalc C sx t td��}tD ]b}tdd�D ]R}tjt�� |d�}| j||d�}|�|� |�d� | � |�}| �
|� � |� q qd S )NrT r � )Z buffer_sizer� r ) r� r� r� r, �BufferedRandomr4 rb r� r. rc r� r@ )r& r� r� Zbuf_sizer� r� rq r r r �"test_unpickling_buffering_readline
s
zFAbstractPicklerUnpicklerObjectTests.test_unpickling_buffering_readline)r0 r1 r2 rb rc r� rj ro rr rt rv rw ry rz r} r r r r ra |
s ra Zreduce_Ac @ s e Zd Zdd� ZdS )r c C s
t tffS r )rW r r) r r r rS s zAAA.__reduce__Nr{ r r r r r s r c @ s e Zd Zdd� Zdd� ZdS )�BBBc C s
d| _ d S )Nzsome attribute�rZ r) r r r r9 $ s z BBB.__init__c C s
d| _ d S )N�BBB.__setstate__r r) r r r r+ ) s r� N)r0 r1 r2 r9 r+ r r r r r~ # s r~ c C s
d| _ dS )at Custom state setter for BBB objects
Such callable may be created by other persons than the ones who created the
BBB class. If passed as the state_setter item of a custom reducer, this
allows for custom state setting behavior of BBB objects. One can think of
it as the analogous of list_setitems or dict_setitems but for foreign
classes/functions.
�custom state_setterNr )rw r� r r r � setstate_bbb- s r� c @ s e Zd ZdZdd� ZdS )�AbstractCustomPicklerClassz<Pickler implementing a reducing hook using reducer_override.c C sL t |dd �}|dkr tdfS |dkr,tdfS |dkr8dS |dkrHtd ��tS )
Nr0 r� )rh �MyClass)�some str�gF�h�The reducer just failed)r� r� rW r� r� )r& rw Zobj_namer r r �reducer_override< s z+AbstractCustomPicklerClass.reducer_overrideN)r0 r1 r2 r: r� r r r r r� : s r� c @ s" e Zd Zdd� Zejdd� �ZdS )�AbstractHookTestsc C s� dd� }dd� }dd� }G dd� d�}t d tjd
�D ]�}| j|d ��� t�� }| �||�}|�||tj g� t�
|� � �\}} }
| � |d � | � | d
� | �
|
tj � | �tj�� |�|� W 5 Q R X | �td�� |�|� W 5 Q R X W 5 Q R X q6d S )Nc S s d S r r r r r r r� X s z.AbstractHookTests.test_pickler_hook.<locals>.fc S s d S r r r r r r r� [ s z.AbstractHookTests.test_pickler_hook.<locals>.gc S s d S r r r r r r r� ^ s z.AbstractHookTests.test_pickler_hook.<locals>.hc @ s e Zd ZdS )z4AbstractHookTests.test_pickler_hook.<locals>.MyClassNrP r r r r r� a s r� r r r_ rh r� r� )r� r r� r� r, r4 rb r� �math�logr� r5 r� r� r� r| ZassertRaisesRegexr� ) r& r� r� r� r� r� �bior �new_fZsome_strZmath_logr r r �test_pickler_hookS s( �z#AbstractHookTests.test_pickler_hookc
C s� t dtjd �D ]v}| j|d��` dd� }t�|�}t�� }| �||�}|� |� t�
|� � �}|dkslt �~~| �
|� � W 5 Q R X qd S )Nr r r_ c S s d S r r r r r r r� � s zEAbstractHookTests.test_reducer_override_no_reference_cycle.<locals>.frh )r� r r� r� r? �refr, r4 rb r� r� r5 r� r� )r& r� r� �wrr� r r� r r r �(test_reducer_override_no_reference_cycle{ s
z:AbstractHookTests.test_reducer_override_no_reference_cycleN)r0 r1 r2 r� r Z cpython_onlyr� r r r r r� R s (r� c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd S )
�AbstractDispatchTableTestsc C sD t �� }| �|d�}| �t�� |j W 5 Q R X | �t|d�� d S )Nr �dispatch_table)r, r4 rb r� r� r� rF r� )r& r� r r r r �test_default_dispatch_table� s
z6AbstractDispatchTableTests.test_default_dispatch_tablec s@ �� � �G �fdd�d�j�� d� ��fdd� }��|�� d S )Nc s e Zd Z� ZdS )zGAbstractDispatchTableTests.test_class_dispatch_table.<locals>.MyPicklerN)r0 r1 r2 r� r )�dtr r � MyPickler� s r� c s2 t �� }� ||�}��|j�� |�| � |�� S r )r, r4 r� r� r� r5 �rw rn r� r �r� r� r& r r r� � s
zCAbstractDispatchTableTests.test_class_dispatch_table.<locals>.dumps)N)�get_dispatch_tablerb �_test_dispatch_table�r& r� r r� r �test_class_dispatch_table� s z4AbstractDispatchTableTests.test_class_dispatch_tablec s( �� � � d� �fdd� }��|� � d S )Nc s: t �� }��||�}� |_��|j� � |�| � |�� S r )r, r4 rb r� r� r� r5 r� �r� r& r r r� � s
zFAbstractDispatchTableTests.test_instance_dispatch_table.<locals>.dumps)N)r� r� r� r r� r � test_instance_dispatch_table� s z7AbstractDispatchTableTests.test_instance_dispatch_tablec s� �fdd�}dd� }d}| � ||�|� | � ||�|� d� � fdd�}||t< | � ||�� � | � ||�|� t� }t� }| � ||�t� | �||�t� | � ||�t� | �||�t� ||t< | � ||�t� | � ||�� � | � ||�t� | �||�t� d ��fd
d �} | |t< |t= | � ||��� | �||�t� | � ||�t� | �||�t� | � ||�jd � d
d� }
|
|t< | � ||�jd� d S )Nc s t �� | d��S �Nr )r r� r� r� r r �custom_load_dump� s zIAbstractDispatchTableTests._test_dispatch_table.<locals>.custom_load_dumpc S s t �t �| d��S r� )r r� r� r� r r r �default_load_dump� s zJAbstractDispatchTableTests._test_dispatch_table.<locals>.default_load_dumpy �? @�reduce_1c s
t � ffS r rV r� )�REDUCE_1r r r� � s zAAbstractDispatchTableTests._test_dispatch_table.<locals>.reduce_1�reduce_2c s
t � ffS r rV r� )�REDUCE_2r r r� � s zAAbstractDispatchTableTests._test_dispatch_table.<locals>.reduce_2r� c S s t d| jd d tfS rM )r~ rE r� r� r r r �
reduce_bbb� s zCAbstractDispatchTableTests._test_dispatch_table.<locals>.reduce_bbbr� )r� �complexr r~ r r� rZ ) r& r� r� r� r� r� r� rZ r[ r� r� r )r� r� r� r r� � sB
z/AbstractDispatchTableTests._test_dispatch_tableN)r0 r1 r2 r� r� r� r� r r r r r� � s r� r� z DATA{0} = (r� z {0!r}r� z# Disassembly of DATA{0}zDATA{0}_DIS = """\z""")�r' r= r% r, r# rt r� r r rv r� rx r~ r r? �textwrapr Z http.cookiesr r� � ImportError�testr Z test.supportr r r r r r
r r r
r r Znumpyr Z
skipUnlessr� r� r� r� r� r r r" r4 r# r� r3 r; rD rI rL rO rQ rT r1 r� rU rX r_ r\ r] r^ ra rl rf r r� r� r� r� r� r� r� Z DATA2_DISr� Z DATA3_DISr� Z DATA4_DISr� r� r� r� �ArithmeticErrorr� r� r� � BufferError� BytesWarning�DeprecationWarningrd �EnvironmentErrorr� �FloatingPointError�
FutureWarning�
GeneratorExit�IOError�
ImportWarning�IndentationError�
IndexErrorr �KeyboardInterrupt� LookupError� MemoryError� NameErrorr$ �OSErrorr� �PendingDeprecationWarning�ReferenceErrorry �RuntimeWarning�
StopIteration� SyntaxError�
SyntaxWarning� SystemError�
SystemExit�TabErrorr* �UnboundLocalError� UnicodeError�UnicodeWarning� UserWarningr� �Warningr r� r� r� r� ZTestCaser� r� r rl ro rr rt rv r� r� r� r> �floatr- r� r. rW r/ r0 r� r� r� r� rb r� r� r� r� r� r8 rj rC rf rh rx r6 rQ r[ ra r r r~ r� r� r� r� r0 r� r! r� r� r r� rr r� �jr[ r r r r �<module> s�
0
�
N�S�A�:�:�
C�0 g 0
�k( "
Bk
Zerion Mini Shell 1.0