File: //lib/python3/dist-packages/awscli/__pycache__/testutils.cpython-38.pyc
U
>�^ˌ �
@ s d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
mZ ddlmZmZ ddlmZ z ddlZW n& ek
r� Z zdZW 5 dZ[X Y nX ddlmZ ddlmZ ddlmZ dd lm Z ddl Z dd
l m Z ddl!Z"dd l#m$Z$ dd l!m%Z% dd
l"m&Z& ddl'Z'ej(�rLe'j)j*e'j)_+e j,�-� Z.e�/d�Z0da1dd� Z2dd� Z3dd� Z4dd� Z5dd� Z6dd� Z7e
j8dd � �Z9dTd d �Z:d d � Z;dUd#d$�Z<G d%d&� d&e'j)�Z=G d'd(� d(e=�Z>G d)d*� d*e?�Z@G d+d,� d,e?�ZAe
j8d-d.� �ZBe
j8dVd0d1��ZCG d2d3� d3e'j)�ZDG d4d5� d5eD�ZEG d6d7� d7e'j)�ZFG d8d9� d9e?�ZGG d:d;� d;eH�ZIG d<d=� d=e?�ZJd>d?� ZKdWdBdC�ZLdDdE� ZMdFdG� ZNdHdI� ZOG dJdK� dKe'j)�ZPG dLdM� dMe�ZQG dNdO� dOe?�ZRG dPdQ� dQeH�ZSG dRdS� dSe?�ZTdS )Xa^ Test utilities for the AWS CLI.
This module includes various classes/functions that help in writing
CLI unit/integration tests. This module should not be imported by
any module **except** for test code. This is included in the CLI
package so that code that is not part of the CLI can still take
advantage of all the testing utilities we provide.
� N)�pformat)�Popen�PIPE)�StringIO)�six)�Session)� ClientError)� WaiterError)� AWSResponse)� load_plugins)� CLIDriver)�EnvironmentVariableszawscli.tests.integrationc s � fdd�}|S )z�Decorator to skip tests that should not be run on windows.
Example usage:
@skip_if_windows("Not valid")
def test_some_non_windows_stuff(self):
self.assertEqual(...)
c s t �t�� dk� �| �S )N)�Darwin�Linux)�unittestZskipIf�platform�system)�func��reason� �2/usr/lib/python3/dist-packages/awscli/testutils.py� decoratorX s
��z"skip_if_windows.<locals>.decoratorr )r r r r r �skip_if_windowsN s
r c C s: zt �| d� W n$ ttfk
r4 t �| d� Y nX dS )z4Helper function to set an invalid last modified time)���l���� h�] )r r N)�os�utime�OSError�
OverflowError)�pathr r r �set_invalid_utime^ s r c C sF t j�� } | j}|�d��tj�}|s*g }tj �
|� |� dt� | S )N� data_pathZ data_loader) �awscliZ clidriver�create_clidriver�sessionZget_config_variable�splitr �pathsep�_LOADERZ search_paths�extendZregister_component)�driverr$ r! r r r r# j s
r# c C sb dd l } td kr^tj�tj�| j��}tj�|dd�}tj�|�sZt d�}|d krZt
d��|atS )Nr �bin�awsz�Could not find "aws" executable. Either make sure it is on your PATH, or you can explicitly set this value using "set_aws_cmd()") r" �AWS_CMDr r �dirname�abspath�__file__�join�isfile�_search_path_for_cmd�
ValueError)r" Z repo_root�aws_cmdr r r � get_aws_cmdu s r5 c C sB t j�dd��t j�D ]&}t j�|| �}t j�|�r| S qd S )N�PATH� )r �environ�getr% r& r r0 r1 )Zcmd_namer Z
full_cmd_pathr r r r2 � s
r2 c C s | a d S �N)r, )r4 r r r � set_aws_cmd� s r; c c sf t �� }dttd�� }tj�||�}t|d��� z t|| �� }|V W 5 Q R X W 5 t �
|� X dS )af This is a cross platform temporary file creation.
tempfile.NamedTemporary file on windows creates a secure temp file
that can't be read by other processes and can't be opened a second time.
For tests, we generally *want* them to be read multiple times.
The test fixture writes the temp file contents, the test reads the
temp file.
z
tmpfile-%s� �wN) �tempfile�mkdtemp�str� random_charsr r r0 �open�close�shutil�rmtree)�modeZtemporary_directory�basenameZ
full_filename�fr r r �temporary_file� s rI c
C s� |sd}| j d|d�}|r |}nt� }d|i}|dkrBd|i|d< z|jf |� W n: tk
r� } z |jd �d �d
krzn� W 5 d }~X Y nX |S ) zG
Creates a bucket
:returns: the name of the bucket created
� us-west-2�s3�Z region_name�Bucket� us-east-1ZLocationConstraintZCreateBucketConfiguration�Error�CodeZBucketAlreadyOwnedByYouN)�
create_client�random_bucket_name�
create_bucketr �responser9 )r$ �name�region�client� bucket_name�params�er r r rS � s rS c C s t �t�t| d ����d�S )zZReturns random hex characters.
Useful for creating resources with random names.
� �ascii)�binasciiZhexlifyr �urandom�int�decode)Z num_charsr r r rA � s rA �awscli-s3integ-� c C s | t |� S )a Generate a random S3 bucket name.
:param prefix: A prefix to use in the bucket name. Useful
for tracking resources. This default value makes it easy
to see which buckets were created from CLI integ tests.
:param num_random: Number of random chars to include in the bucket name.
:returns: The name of a randomly generated bucket name as a string.
)rA )�prefixZ
num_randomr r r rR � s rR c @ s e Zd ZdZdd� Zdd� ZdS )�BaseCLIDriverTestz�Base unittest that use clidriver.
This will load all the default plugins as well so it
will simulate the behavior the user will see.
c C sH t jd ddddd�| _t�d| j�| _| j�� t� | _| jj| _d S )N�
AWS_DATA_PATHrN �
access_key�
secret_keyr7 �re �AWS_DEFAULT_REGION�AWS_ACCESS_KEY_ID�AWS_SECRET_ACCESS_KEY�AWS_CONFIG_FILE�
os.environ) r r8 �mock�patch�
environ_patch�startr# r) r$ ��selfr r r �setUp� s �
zBaseCLIDriverTest.setUpc C s | j �� d S r: )rp �stoprr r r r �tearDown� s zBaseCLIDriverTest.tearDownN)�__name__�
__module__� __qualname__�__doc__rt rv r r r r rd � s
rd c sH e Zd Z� fdd�Z� fdd�Zdd� Zdd� Zd d
� Zd d � Z� Z S )
�BaseAWSHelpOutputTestc s< t t| ��� t�d�| _| j�� | _t� | _ | j | j_
d S )Nzawscli.help.get_renderer) �superr{ rt rn ro �renderer_patchrq Z
renderer_mock�CapturedRenderer�renderer� return_valuerr �� __class__r r rt � s
zBaseAWSHelpOutputTest.setUpc s t t| ��� | j�� d S r: )r| r{ rv r} ru rr r� r r rv � s z BaseAWSHelpOutputTest.tearDownc C s& || j jkr"| �d|| j jf � d S )NzFThe expected contents:
%s
were not in the actual rendered contents:
%s�r �rendered_contents�fail)rs �containsr r r �assert_contains s ��z%BaseAWSHelpOutputTest.assert_containsc C s4 | j j�|�}||kr0| �d||| j j|f � d S )NzkThe expected contents:
%s
, with the count:
%d
were not in the actual rendered contents:
%s
with count:
%d)r r� �countr� )rs r� r� Zr_countr r r �assert_contains_with_count s ��z0BaseAWSHelpOutputTest.assert_contains_with_countc C s& || j jkr"| �d|| j jf � d S )NzKThe contents:
%s
were not suppose to be in the actual rendered contents:
%sr� �rs �contentsr r r �assert_not_contains s ��z)BaseAWSHelpOutputTest.assert_not_containsc s� |� d�}t|�}| jj� | �|� � � �|��� �fdd�|D �}|d }t|dd � d�D ]R\}}|dkr�| �d|| � f � ||k r�| �d|| ||d � f � |}q^d S ) N�
starting_fromc s g | ]}� � |���qS r )�find)�.0�arg�r� Z start_indexr r �
<listcomp> s z;BaseAWSHelpOutputTest.assert_text_order.<locals>.<listcomp>r � r z/The string %r was not found in the contents: %szBThe string %r came before %r, but was suppose to come after it.
%s)�pop�listr r� �assertInr� � enumerater� )rs �args�kwargsr� Z arg_indicesZprevious�i�indexr r� r �assert_text_order s"
��z'BaseAWSHelpOutputTest.assert_text_order)
rw rx ry rt rv r� r� r� r� �
__classcell__r r r� r r{ � s r{ c @ s e Zd Zdd� Zdd� ZdS )r~ c C s
d| _ d S )Nr7 )r� rr r r r �__init__) s zCapturedRenderer.__init__c C s |� d�| _d S )N�utf-8)r` r� r� r r r �render, s zCapturedRenderer.renderN)rw rx ry r� r� r r r r r~ ( s r~ c @ s e Zd Zdd� ZdS )�CapturedOutputc C s || _ || _d S r: )�stdout�stderr)rs r� r� r r r r� 1 s zCapturedOutput.__init__N)rw rx ry r� r r r r r� 0 s r� c
c sP t �� } t �� }t�d| ��* t�d|�� t|| �V W 5 Q R X W 5 Q R X d S )Nz
sys.stderrz
sys.stdout)r r rn ro r� )r� r� r r r �capture_output6 s
r� � c c sF t �| �}t jr t�� }||_n|}t�d|�� |V W 5 Q R X d S )Nz sys.stdin)r �BytesIO�PY3rn �Mock�bufferro )Z input_bytes�
input_dataZ mock_objectr r r �
capture_input? s
r� c @ sT e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zdd
d�Z dd� Z
ddd�Z dS )�BaseAWSCommandParamsTestNc C s� i | _ d | _tjd dddddd�| _t�d| j�| _| j�� td di d �| _ i | _
t�d �| _ d
| _ g | _
d | _t� | _d S ) Nre rN rf rg r7 )re ri rj rk rl ZAWS_SHARED_CREDENTIALS_FILErm �� z'botocore.endpoint.Endpoint.make_requestF)� last_params� last_kwargsr r8 rn ro rp rq r
�
http_response�parsed_response�make_request_patch�make_request_is_patched�operations_called�parsed_responsesr# r) rr r r r rt O s$ �
z BaseAWSCommandParamsTest.setUpc C s$ | j �� | jr | j�� d| _d S �NF)rp ru r� r� rr r r r rv i s
z!BaseAWSCommandParamsTest.tearDownc K s | � |� d S r: )�
_store_params)rs rY r� r r r � before_callp s z$BaseAWSCommandParamsTest.before_callc C s || _ |d | _d S )NZbody)Zlast_request_dictr� )rs rY r r r r� s s z&BaseAWSCommandParamsTest._store_paramsc sR � j r� j�� d� _ � j�� }� jd k r:� fdd�|_n� j� jf|_d� _ d S )NFc s � j � j�d�fS �Nr )r� r� r� )r� r� rr r r �<lambda>� s z=BaseAWSCommandParamsTest.patch_make_request.<locals>.<lambda>T) r� r� ru rq r� Z side_effectr� r� r� )rs r� r rr r �patch_make_requestw s
z+BaseAWSCommandParamsTest.patch_make_requestr c C s� | � ||�\}}}|d k r&| �||� |d k r�t�| j�} |d k rl|D ]$}
z
| |
= W qF tk
rh Y qFX qF|| kr�| �dt|�t| �f � |||fS )NzGActual params did not match expected params.
Expected:
%s
Actual:
%s
)�run_cmdr� �copyr� �KeyErrorr� r ) rs �cmdrY � expected_rcZstderr_containsZ
ignore_paramsr� r� �rcr� �keyr r r �assert_params_for_cmd� s$
��z.BaseAWSCommandParamsTest.assert_params_for_cmdc K s || _ | j�||�� f� d S r: )r� r� �appendr� )rs rY Zmodelr� r r r �before_parameter_build� s z/BaseAWSCommandParamsTest.before_parameter_buildc
C s� t �d|� | �� | jj�d�}|�d| j� |�d| j � t
|t �sR|� � }n|}t
� �@}z| j�|�}W n( tk
r� } z
|j}W 5 d }~X Y nX W 5 Q R X |j�� }|j�� } | �||d|||| |f � | ||fS )NzCalling cmd: %s�
event_emitterz before-callzbefore-parameter-build.*.*�MUnexpected rc (expected: %s, actual: %s) for command: %s
stdout:
%sstderr:
%s)�logging�debugr� r) r$ �
get_component�registerr� Zregister_firstr� �
isinstancer� r% r� �main�
SystemExit�coder� �getvaluer� � assertEqual)
rs r� r� r� �cmdlist�capturedr� rZ r� r� r r r r� � s> �
"
���z BaseAWSCommandParamsTest.run_cmd)Nr NN)r ) rw rx ry ZmaxDiffrt rv r� r� r� r� r� r� r r r r r� L s �
r� c s( e Zd Z� fdd�Z� fdd�Z� ZS )� BaseAWSPreviewCommandParamsTestc s( t �d�| _| j�� tt| ��� d S )Nz-awscli.customizations.preview.mark_as_preview)rn ro �
preview_patchrq r| r� rt rr r� r r rt � s
�
z%BaseAWSPreviewCommandParamsTest.setUpc s | j �� tt| ��� d S r: )r� ru r| r� rv rr r� r r rv � s
z(BaseAWSPreviewCommandParamsTest.tearDown)rw rx ry rt rv r� r r r� r r� � s r� c @ s6 e Zd Zdd� Zdd� Zdi dfdd�Zd
d
d �Zd S )�BaseCLIWireResponseTestc C sP t jd ddddd�| _t�d| j�| _| j�� t�d�| _d | _t� | _ d S )
Nre rN rf rg r7 rh rm z botocore.endpoint.Endpoint._sendF)
r r8 rn ro rp rq �
send_patch�send_is_patchedr# r) rr r r r rt � s �
z BaseCLIWireResponseTest.setUpc C s$ | j �� | jr | j�� d| _d S r� )rp ru r� r� rr r r r rv � s
z BaseCLIWireResponseTest.tearDownr� r� c C s< | j r| j�� d| _ | j�� }tj|||d�|_d| _ d S )NF)� status_code�headers�contentT)r� r� ru rq rn r� r� )rs r� r� r� r� r r r �
patch_send� s
�z"BaseCLIWireResponseTest.patch_sendr c C s� t |t�s|�� }n|}t� �@}z| j�|�}W n( tk
rX } z
|j}W 5 d }~X Y nX W 5 Q R X |j� � }|j
� � }| � ||d|||||f � |||fS )Nr� ) r� r� r% r� r) r� r� r� r� r� r� r� ) rs r� r� r� r� r� rZ r� r� r r r r� � s.
"
���z BaseCLIWireResponseTest.run_cmdN)r )rw rx ry rt rv r� r� r r r r r� � s
r� c @ s6 e Zd Zdd� Zdd� Zd
dd�Zd d
� Zd d � ZdS )� FileCreatorc C s t �� | _d S r: )r> r? �rootdirrr r r r r� s zFileCreator.__init__c C s t j�| j�rt�| j� d S r: )r r �existsr� rD rE rr r r r �
remove_all s zFileCreator.remove_allNr= c C s� t j�| j|�}t j�t j�|��s6t �t j�|�� t||��}|�|� W 5 Q R X t j� |�}t �
|||d f� |dk r�t �
|||f� |S )a� Creates a file in a tmpdir
``filename`` should be a relative path, e.g. "foo/bar/baz.txt"
It will be translated into a full path in a tmp dir.
If the ``mtime`` argument is provided, then the file's
mtime will be set to the provided value (must be an epoch time).
Otherwise the mtime is left untouched.
``mode`` is the mode the file should be opened either as ``w`` or
`wb``.
Returns the full path to the file.
i �N) r r r0 r� �isdirr- �makedirsrB �write�getmtimer )rs �filenamer� �mtimerF � full_pathrH Z current_timer r r � create_file s zFileCreator.create_filec C sZ t j�| j|�}t j�t j�|��s6t �t j�|�� t|d��}|�|� W 5 Q R X |S )z�Append contents to a file
``filename`` should be a relative path, e.g. "foo/bar/baz.txt"
It will be translated into a full path in a tmp dir.
Returns the full path to the file.
�a) r r r0 r� r� r- r� rB r� )rs r� r� r� rH r r r � append_file% s zFileCreator.append_filec C s t j�| j|�S )zzTranslate relative path to full path in temp dir.
f.full_path('foo/bar.txt') -> /tmp/asdfasd/foo/bar.txt
)r r r0 r� )rs r� r r r r� 4 s zFileCreator.full_path)Nr= )rw rx ry r� r� r� r� r� r r r r r� s
r� c @ s e Zd ZdS )�ProcessTerminatedErrorN�rw rx ry r r r r r� < s r� c @ s" e Zd Zddd�Zedd� �ZdS )�ResultNc C sL || _ || _|| _t�d|� t�d|� t�d|� |d krBg }|| _d S )Nzrc: %sz
stdout: %sz
stderr: %s)r� r� r� � INTEG_LOGr� � memory_usage)rs r� r� r� r� r r r r� A s zResult.__init__c C s t �| j�S r: )�json�loadsr� rr r r r r� L s z Result.json)N)rw rx ry r� �propertyr� r r r r r� @ s
r� c C s | � dd�} | � dd�} | S )N�"z\"�')�replace)�commandr r r �_escape_quotesQ s r� FTc C s t �� dkrt| �} dtjkr*tjd }n
dt� }d|| f }t� }t|tj �rbtj
sb|� |�}t �
d|� tj�� } d| kr�d| d< |dk r�|} |dkr�t}t|tt|d | d
�}
|s�|
S d} |s�i } |r�d |i} |
jf | �\}
}nt|
�\}
}} t|
j|
�|�|�|�| �S ) a] Run an aws command.
This help function abstracts the differences of running the "aws"
command on different platforms.
If collect_memory is ``True`` the the Result object will have a list
of memory usage taken at 2 second intervals. The memory usage
will be in bytes.
If env_vars is None, this will set the environment variables
to be used by the aws process.
If wait_for_finish is False, then the Process object is returned
to the caller. It is then the caller's responsibility to ensure
proper cleanup. This can be useful if you want to test timeout's
or how the CLI responds to various signals.
:type input_data: string
:param input_data: This string will be communicated to the process through
the stdin of the process. It essentially allows the user to
avoid having to use a file handle to pass information to the process.
Note that this string is not passed on creation of the process, but
rather communicated to the process.
:type input_file: a file handle
:param input_file: This is a file handle that will act as the
the stdin of the process immediately on creation. Essentially
any data written to the file will be read from stdin of the
process. This is needed if you plan to stream data into stdin while
collecting memory.
ZWindowsZAWS_TEST_COMMANDz python %sz%s %szRunning command: %sri rN NT)r� r� �stdin�shell�env�input)r r r� r r8 r5 �get_stdout_encodingr� r Z text_typer� �encoder� r� r� r r � communicate�_wait_and_collect_memr� �
returncoder` )r� Zcollect_memoryZenv_varsZwait_for_finishr� Z
input_fileZ aws_commandZ full_commandZstdout_encodingr� �process�memoryr� r� r� r r r r+ [ sF !
��r+ c C s t tjdd �} | d krd} | S )N�encodingr� )�getattr�sys�
__stdout__)r r r r r� � s r� c C s� t �� dkrt}n"t �� dkr$t}ntdt �� ��g }| �� d krxz|| j�}W n tk
rj Y qxY nX |�|� q8| �� \}}|||fS )Nr r z0Can't collect memory for process on platform %s.) r r �_get_memory_with_psr3 Zpoll�pidr� r� r� )r Z
get_memoryr Zcurrentr� r� r r r r� � s$ ��
r� c C sf d� � }|�t| �� t|td�}|�� d }|jdksFtt| ���n t|� � d � � d �d S d S )Nzps u -p)r� r r� � i )
r% r� r@ r r r� r r� r_ �
splitlines)r Z command_list�pr� r r r r � s
r c @ s� e Zd ZdZddddgZdd� Zdd � Zd
d � Zd d
� Zdd� Z dd� Z
dd� Z d;dd�Z d<dd�Z
d=dd �Zd d � Zd d � Zd!d"� Zd>d$d%�Zd&d'� Zd?d(d)�Zd@d*d+�Zd,d-� Zd.d/� Zd0d1� ZdAd2d3�ZdBd4d5�ZdCd7d8�Zd9d:� Z dS )D�BaseS3CLICommandz�Base class for aws s3 command.
This contains convenience functions to make writing these tests easier
and more streamlined.
ZSSECustomerAlgorithmZSSECustomerKeyZSSECustomerKeyMD5Z RequestPayerc C s@ t � | _tj�� | _i | _d| _| jjd| jd�| _| � � d S )NrJ rK rL )
r� �files�botocorer$ Z get_session�regionsrV rQ rW � extra_setuprr r r r rt � s zBaseS3CLICommand.setUpc C s d S r: r rr r r r r � s z BaseS3CLICommand.extra_setupc C s | j �� | �� d S r: )r
r� �extra_teardownrr r r r rv � s
zBaseS3CLICommand.tearDownc C s d S r: r rr r r r r � s z BaseS3CLICommand.extra_teardownc K s | j �d�}|jf |� d S )NZresponse_parser_factory)r$ r� Zset_parser_defaults)rs r� �factoryr r r �override_parser� s z BaseS3CLICommand.override_parserc C s$ | j �|| j�}| jjd|d�}|S )NrK rL )r r9 rV r$ rQ )rs rX rV rW r r r �create_client_for_bucket� s z)BaseS3CLICommand.create_client_for_bucketc C sd | � ||� t|tj�r&|�� �d�}| �||�}| �t|�t|�� ||kr`| � d||f � d S )Nr� z?Contents for %s/%s do not match (but they have the same length))
�wait_until_key_existsr� r r� r� r` �get_key_contentsr� �lenr� )rs Zbucketr� Zexpected_contentsZactual_contentsr r r �assert_key_contents_equal� s �z*BaseS3CLICommand.assert_key_contents_equalNc C s> |s
| j }t| j||�}|| j|< | �| j|� | �|� |S r: )rV rS r$ r �
addCleanup�
delete_bucket�wait_bucket_exists)rs rU rV rX r r r rS s
z BaseS3CLICommand.create_bucketr7 c sz � � |�}|||d�}|d k r(|�|� |jf |�}� �� j||� i }|rft� fdd�|�� D ��}� j|||d� |S )N)rM �Key�Bodyc 3 s$ | ] \}}|� j kr||fV qd S r: )�_PUT_HEAD_SHARED_EXTRAS)r� �k�vrr r r � <genexpr> s
�z.BaseS3CLICommand.put_object.<locals>.<genexpr>)� extra_params)r �update�
put_objectr �
delete_key�dict�itemsr ) rs rX �key_namer� Z
extra_argsrW Z call_argsrT Zextra_head_paramsr rr r r$ s(
�
��zBaseS3CLICommand.put_objectr c C s� | � |� | �|�}|}|d8 }z|j|d� W qrW q |jjk
rn | �|�rVY qr|dkr`� t�|� Y qX q| j� |d � d S )Nr� �rM r )
�remove_all_objectsr r �
exceptionsZ NoSuchBucket�bucket_not_exists�time�sleepr r� )rs rX �attempts�delayrW Zattempts_remainingr r r r ' s
z BaseS3CLICommand.delete_bucketc C sb | � |�}|�d�}|j|d�}g }|D ] }|dd� |�dg �D �7 }q(|D ]}| �||� qLd S )NZ list_objectsr) c S s g | ] }|d �qS )r r )r� �objr r r r� D s z7BaseS3CLICommand.remove_all_objects.<locals>.<listcomp>ZContents)r Z
get_paginatorZpaginater9 r% )rs rX rW Z paginatorZpagesZ key_namesZpager( r r r r* > s
z#BaseS3CLICommand.remove_all_objectsc C s | � |�}|j||d�}d S �N�rM r )r Z
delete_object�rs rX r( rW rT r r r r% H s
zBaseS3CLICommand.delete_keyc C s6 | � ||� | �|�}|j||d�}|d �� �d�S )Nr3 r r� )r r Z
get_object�readr` r4 r r r r L s
z!BaseS3CLICommand.get_key_contents� c s8 | � � �}|�d��t|dd�}|�� �fdd�� d S )NZ
bucket_existsT)�
min_successes�delay_initial_pollc s �j � d�d kS )Nr) )�waitr �rX �waiterr r r� X r� z5BaseS3CLICommand.wait_bucket_exists.<locals>.<lambda>)r �
get_waiter�ConsistencyWaiterr9 )rs rX r7 rW Zconsistency_waiterr r: r r R s
� �z#BaseS3CLICommand.wait_bucket_existsc
C s` | � |�}z|j|d� W dS tk
rZ } z |j�d�dkrHW Y �
dS � W 5 d }~X Y nX d S )Nr) TrP Z404F)r Z head_bucketr rT r9 )rs rX rW �errorr r r r, [ s
z"BaseS3CLICommand.bucket_not_existsc C s6 z| j |||d� W dS ttfk
r0 Y dS X d S �N)r7 TF)r r r �rs rX r( r7 r r r �
key_existse s �zBaseS3CLICommand.key_existsc C s6 z| j |||d� W dS ttfk
r0 Y dS X d S r? )�wait_until_key_not_existsr r r@ r r r �key_not_existsm s �z BaseS3CLICommand.key_not_existsc C s | j �� }|d S )NZBuckets)rW � list_buckets)rs rT r r r rD u s
z BaseS3CLICommand.list_bucketsc C s | � ||�}|d S )NZ ContentType)� head_object)rs rX r( Zparsedr r r �content_type_for_keyy s z%BaseS3CLICommand.content_type_for_keyc C s | � |�}|j||d�}|S r2 )r rE r4 r r r rE } s
z BaseS3CLICommand.head_objectc C s | j ||||dd� d S )NT�r� ��
_wait_for_key�rs rX r( r" r7 r r r r � s
�z&BaseS3CLICommand.wait_until_key_existsc C s | j ||||dd� d S )NFrG rH rJ r r r rB � s
�z*BaseS3CLICommand.wait_until_key_not_existsTc
C s^ | � |�}|r|�d�}n
|�d�}||d�}|d k r@|�|� t|�D ]} |jf |� qHd S )NZ
object_existsZobject_not_existsr3 )r r< r# �ranger9 )
rs rX r( r" r7 r� rW r; rY �_r r r rI � s
z BaseS3CLICommand._wait_for_keyc C s^ | � |jdd|j|j|j f � | �d|j� | �d|j� | �d|j� | �d|j� d S )Nr z Non zero rc (%s) received: %szError:zfailed:z client errorz server error)r� r� r� r� Z assertNotIn)rs r r r r �assert_no_errors� s �z!BaseS3CLICommand.assert_no_errors)NN)r7 N)r r )r6 )r6 )r6 )Nr6 )Nr6 )Nr6 T) rw rx ry rz r rt r rv r r r r rS r$ r r* r% r r r, rA rC rD rF rE r rB rI rM r r r r r � sJ �
�
�
�
r c @ s e Zd Zdd� ZdS )�StringIOWithFileNoc C s dS r� r rr r r r �fileno� s zStringIOWithFileNo.filenoN)rw rx ry rO r r r r rN � s rN c @ s* e Zd Zddd�Zedd� �Zdd� ZdS ) �TestEventHandlerNc C s || _ d| _d S r� )�_handler�_called)rs �handlerr r r r� � s zTestEventHandler.__init__c C s | j S r: )rR rr r r r �called� s zTestEventHandler.calledc K s d| _ | jd k r | jf |� d S )NT)rR rQ )rs r� r r r rS � s
zTestEventHandler.handler)N)rw rx ry r� r� rT rS r r r r rP � s
rP c @ s e Zd ZdS )�ConsistencyWaiterExceptionNr� r r r r rU � s rU c @ s* e Zd ZdZd
dd�Zdd � Zd
d � Zd S )r= a�
A waiter class for some check to reach a consistent state.
:type min_successes: int
:param min_successes: The minimum number of successful check calls to
treat the check as stable. Default of 1 success.
:type max_attempts: int
:param min_successes: The maximum number of times to attempt calling
the check. Default of 20 attempts.
:type delay: int
:param delay: The number of seconds to delay the next API call after a
failed check call. Default of 5 seconds.
r� � r Fc C s || _ || _|| _|| _d S r: )r7 � max_attemptsr0 r8 )rs r7 rW r0 r8 r r r r� � s zConsistencyWaiter.__init__c O st d}d}| j rt�| j� || jk r\|d7 }|||�rN|d7 }|| jkrZdS qt�| j� q| �||�}t|��dS )a�
Wait until the check succeeds the configured number of times
:type check: callable
:param check: A callable that returns True or False to indicate
if the check succeeded or failed.
:type args: list
:param args: Any ordered arguments to be passed to the check.
:type kwargs: dict
:param kwargs: Any keyword arguments to be passed to the check.
r r� N)r8 r- r. r0 rW r7 �
_fail_messagerU )rs Zcheckr� r� r/ � successesZfail_msgr r r r9 � s
zConsistencyWaiter.waitc C s ||f}d| S )Nz/Failed after %s attempts, only had %s successesr )rs r/ rY Z format_argsr r r rX � s z ConsistencyWaiter._fail_messageN)r� rV r F)rw rx ry rz r� r9 rX r r r r r= � s �
r= )NN)ra rb )r� )FNTNN)Urz r r r� rD r- r� r� r> r �
contextlib�stringr] Zpprintr �
subprocessr r Z
awscli.compatr rn � ImportErrorrZ r Zbotocore.sessionr Zbotocore.exceptionsr r Zbotocore.loadersr Zbotocore.awsrequestr
Zawscli.clidriverr" Z
awscli.pluginr r r
r ZPY2ZTestCaseZassertItemsEqualZassertCountEqual�loaders�Loaderr' Z getLoggerr� r, r r r# r5 r2 r; �contextmanagerrI rS rA rR rd r{ �objectr~ r� r� r� r� r� r� r� � Exceptionr� r� r� r+ r� r� r r rN rP rU r= r r r r �<module>
s�
3
t 5;
�
E V