VSf_dZddlZddlZddlmZddlZddlmZddlmZddl m Z ddl m Z ddl mZdd lmZdd lmZdd lmZd Z d Z dZ dZdZej3eZdZej8edZ dZdZdZ ejjBZ"ejFjHZ%dZ&dZ'dZ(d*dZ)dZ*dZ+dZ,Gdde-Z.d Z/d+d!Z0d"Z1d#Z2d$Z3d%Z4d,d&Z5d,d'Z6d(Z7 d-d)Z8y).zVHelper functions for Cloud Storage utility classes. These are *not* part of the API. N)md5)urlsplit) urlunsplit)uuid4)resumable_media)environment_vars)_DEFAULT_TIMEOUT) DEFAULT_RETRY))DEFAULT_RETRY_IF_METAGENERATION_SPECIFIEDSTORAGE_EMULATOR_HOSTAPI_ENDPOINT_OVERRIDEAPI_VERSION_OVERRIDEzgoogleapis.comzstorage.{universe_domain})universe_domainzhttps://v1)) if_etag_matchzIf-Match)if_etag_not_matchz If-None-Match))if_generation_matchifGenerationMatch)if_generation_not_matchifGenerationNotMatch)if_metageneration_matchifMetagenerationMatch)if_metageneration_not_matchifMetagenerationNotMatch)if_source_generation_matchifSourceGenerationMatch)if_source_generation_not_matchifSourceGenerationNotMatch)if_source_metageneration_matchifSourceMetagenerationMatch)"if_source_metageneration_not_matchifSourceMetagenerationNotMatchz`num_retries` has been deprecated and will be removed in a future release. Use the `retry` argument with a Retry or ConditionalRetryPolicy object, or None, instead.cJtjjtdSN)osenvirongetSTORAGE_EMULATOR_ENV_VAR\C:\Users\user\Documents\project_loop\venv\Lib\site-packages\google/cloud/storage/_helpers.py_get_storage_emulator_overrider,Xs ::>>2D 99r*cLtjtttzSr$)r%getenv_API_ENDPOINT_OVERRIDE_ENV_VAR_DEFAULT_SCHEME_TRUE_DEFAULT_STORAGE_HOSTr)r*r+_get_default_storage_base_urlr2\s 99&:T(T r*cHtttzk7r tSy)zIThis is an experimental configuration variable. Use api_endpoint instead.N)r2r0r1r)r*r+_get_api_endpoint_overrider4bs$&/||_i|_t|_yr$)rO _propertiesset_changes)selfrOs r+__init__z_PropertyMixin.__init__s  r*ct)z$Abstract getter for the object path.NotImplementedErrorrWs r+pathz_PropertyMixin.path "!r*ct)z&Abstract getter for the object client.rZr\s r+clientz_PropertyMixin.clientr^r*ct)z,Abstract getter for the object user_project.rZr\s r+ user_projectz_PropertyMixin.user_projectr^r*c"| |j}|S)aCheck client or verify over-ride. :type client: :class:`~google.cloud.storage.client.Client` or ``NoneType`` :param client: the client to use. If not passed, falls back to the ``client`` stored on the current object. :rtype: :class:`google.cloud.storage.client.Client` :returns: The client passed in or the currently bound client. )r`)rWr`s r+_require_clientz_PropertyMixin._require_clients >[[F r*ciS)a@Return any encryption headers needed to fetch the object. .. note:: Defined here because :meth:`reload` calls it, but this method is really only relevant for :class:`~google.cloud.storage.blob.Blob`. :rtype: dict :returns: a mapping of encryption-related headers. r)r\s r+_encryption_headersz"_PropertyMixin._encryption_headerss  r*c@i}|j|j|d<|S)zDefault query parameters. userProject)rb)rWparamss r+ _query_paramsz_PropertyMixin._query_paramss*    ($($5$5F= ! r*noAclc |j|}|j} || d<t| ||||| | | d<|j} t | |||j |j | | | | |}|j|y)aReload properties from Cloud Storage. If :attr:`user_project` is set, bills the API request to that project. :type client: :class:`~google.cloud.storage.client.Client` or ``NoneType`` :param client: the client to use. If not passed, falls back to the ``client`` stored on the current object. :type projection: str :param projection: (Optional) If used, must be 'full' or 'noAcl'. Defaults to ``'noAcl'``. Specifies the set of properties to return. :type if_etag_match: Union[str, Set[str]] :param if_etag_match: (Optional) See :ref:`using-if-etag-match` :type if_etag_not_match: Union[str, Set[str]]) :param if_etag_not_match: (Optional) See :ref:`using-if-etag-not-match` :type if_generation_match: long :param if_generation_match: (Optional) See :ref:`using-if-generation-match` :type if_generation_not_match: long :param if_generation_not_match: (Optional) See :ref:`using-if-generation-not-match` :type if_metageneration_match: long :param if_metageneration_match: (Optional) See :ref:`using-if-metageneration-match` :type if_metageneration_not_match: long :param if_metageneration_not_match: (Optional) See :ref:`using-if-metageneration-not-match` :type timeout: float or tuple :param timeout: (Optional) The amount of time, in seconds, to wait for the server response. See: :ref:`configuring_timeouts` :type retry: google.api_core.retry.Retry or google.cloud.storage.retry.ConditionalRetryPolicy :param retry: (Optional) How to retry the RPC. See: :ref:`configuring_retries` :type soft_deleted: bool :param soft_deleted: (Optional) If True, looks for a soft-deleted object. Will only return the object metadata if the object exists and is in a soft-deleted state. :attr:`generation` is required to be set on the blob if ``soft_deleted`` is set to True. See: https://cloud.google.com/storage/docs/soft-delete projectionrrrrN softDeleted)rr) query_paramsheaderstimeoutretry_target_object)rdrj _add_generation_match_parametersrf_add_etag_match_headers _get_resourcer]_set_properties)rWr`rmrrrrrrrrrs soft_deletedrprq api_responses r+reloadz_PropertyMixin.reloadsD%%f-)) &0 \"(  3$;$;(C    #*6L '**, =DU ++ II% ,  \*r*cX|jj|||j|<y)aUpdate field of this object's properties. This method will only update the field provided and will not touch the other fields. It **will not** reload the properties from the server. The behavior is local only and syncing occurs via :meth:`patch`. :type name: str :param name: The field name to update. :type value: object :param value: The value being updated. N)rVaddrT)rWrOvalues r+_patch_propertyz_PropertyMixin._patch_property6s& $!&r*c0||_t|_y)zSet the properties for the current object. :type value: dict or :class:`google.cloud.storage.batch._FutureDict` :param value: The properties to be set. N)rTrUrV)rWr~s r+rxz_PropertyMixin._set_propertiesHs ! r*Fc 2|j|}|j} d| d<|r|| d<t| |||||jD cic]} | |j| } } |j |j | | |||} |j| ycc} w)ajSends all changed properties in a PATCH request. Updates the ``_properties`` with the response from the backend. If :attr:`user_project` is set, bills the API request to that project. :type client: :class:`~google.cloud.storage.client.Client` or ``NoneType`` :param client: the client to use. If not passed, falls back to the ``client`` stored on the current object. :type if_generation_match: long :param if_generation_match: (Optional) See :ref:`using-if-generation-match` :type if_generation_not_match: long :param if_generation_not_match: (Optional) See :ref:`using-if-generation-not-match` :type if_metageneration_match: long :param if_metageneration_match: (Optional) See :ref:`using-if-metageneration-match` :type if_metageneration_not_match: long :param if_metageneration_not_match: (Optional) See :ref:`using-if-metageneration-not-match` :type timeout: float or tuple :param timeout: (Optional) The amount of time, in seconds, to wait for the server response. See: :ref:`configuring_timeouts` :type retry: google.api_core.retry.Retry or google.cloud.storage.retry.ConditionalRetryPolicy :param retry: (Optional) How to retry the RPC. See: :ref:`configuring_retries` :type override_unlocked_retention: bool :param override_unlocked_retention: (Optional) override_unlocked_retention must be set to True if the operation includes a retention property that changes the mode from Unlocked to Locked, reduces the retainUntilTime, or removes the retention configuration from the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects/patch fullrmoverrideUnlockedRetentionrn)rprtrrrsN)rdrjrurVrT_patch_resourcer]rx) rWr`rrrrrrrsoverride_unlocked_retentionrpkeyupdate_propertiesrzs r+patchz_PropertyMixin.patchRsl%%f-)) &, \" &8SL4 5(  3$;$;(C  DH==QCS$"2"23"77QQ-- II % .  \*RsBc |j|}|j} d| d<|r|| d<t| |||||j|j|j | |||} |j | y)a`Sends all properties in a PUT request. Updates the ``_properties`` with the response from the backend. If :attr:`user_project` is set, bills the API request to that project. :type client: :class:`~google.cloud.storage.client.Client` or ``NoneType`` :param client: the client to use. If not passed, falls back to the ``client`` stored on the current object. :type if_generation_match: long :param if_generation_match: (Optional) See :ref:`using-if-generation-match` :type if_generation_not_match: long :param if_generation_not_match: (Optional) See :ref:`using-if-generation-not-match` :type if_metageneration_match: long :param if_metageneration_match: (Optional) See :ref:`using-if-metageneration-match` :type if_metageneration_not_match: long :param if_metageneration_not_match: (Optional) See :ref:`using-if-metageneration-not-match` :type timeout: float or tuple :param timeout: (Optional) The amount of time, in seconds, to wait for the server response. See: :ref:`configuring_timeouts` :type retry: google.api_core.retry.Retry or google.cloud.storage.retry.ConditionalRetryPolicy :param retry: (Optional) How to retry the RPC. See: :ref:`configuring_retries` :type override_unlocked_retention: bool :param override_unlocked_retention: (Optional) override_unlocked_retention must be set to True if the operation includes a retention property that changes the mode from Unlocked to Locked, reduces the retainUntilTime, or removes the retention configuration from the object. See: https://cloud.google.com/storage/docs/json_api/v1/objects/patch rrmrrn)rprrrsrtN)rdrjru _put_resourcer]rTrx) rWr`rrrrrrrsrrprzs r+updatez_PropertyMixin.updatesl%%f-)) %+ \" &8SL4 5(  3$;$;(C  ++ II   % ,  \*r*r$)__name__ __module__ __qualname____doc__rXpropertyr]r`rbrdrfrjr r r{rrxr rrr)r*r+rRrRs  """"""   $ $$( \+|'$ $ $$( 7$)O+f $ $$( 7$)L+r*rRc0fd}fd}t||S)zHCreate a property descriptor around the :class:`_PropertyMixin` helpers.c:|jjS)zScalar property getter.)rTr')rW fieldnames r+_getterz!_scalar_property.._getters##I..r*c*|j|y)zScalar property setter.N)r)rWr~rs r+_setterz!_scalar_property.._setters Y.r*)r)rrrs` r+_scalar_propertyrs// GW %%r*c|j|}t|dkDr2|j||j|}t|dkDr1yy)aRead blocks from a buffer and update a hash with them. :type buffer_object: bytes buffer :param buffer_object: Buffer containing bytes used to update a hash object. :type hash_obj: object that implements update :param hash_obj: A hash object (MD5 or CRC32-C). :type digest_block_size: int :param digest_block_size: The block size to write to the hash. Defaults to 8192. rN)readlenr) buffer_objecthash_objdigest_block_sizeblocks r+_write_buffer_to_hashrsJ   0 1E e*q.""#45 e*q.r*cxt}t|||j}tj|S)a Get MD5 hash of bytes (as base64). :type buffer_object: bytes buffer :param buffer_object: Buffer containing bytes used to compute an MD5 hash (as base64). :rtype: str :returns: A base64 encoded digest of the MD5 hash. )rrdigestbase64 b64encode)rr digest_bytess r+_base64_md5hashrs2uH-2??$L   L ))r*c tD]@\}}|j|}|t|tr|g}dj |||<By)zAdd generation match parameters into the given parameters list. :type headers: dict :param headers: Headers dict. :type match_parameters: dict :param match_parameters: if*etag*match parameters to add. N, )_ETAG_MATCH_PARAMETERSr' isinstancestrjoin)rqmatch_parameterssnakecase_name header_namer~s r+rvrv%sR(>4#  $$^4  %%#'99U#3GK 4r*c tD]]\}}|j|}|t|tr|j ||f>t|t r|||<Tt dy)abAdd generation match parameters into the given parameters list. :type parameters: list or dict :param parameters: Parameters list or dict. :type match_parameters: dict :param match_parameters: if*generation*match parameters to add. :raises: :exc:`ValueError` if ``parameters`` is not a ``list()`` or a ``dict()``. Nz5`parameters` argument should be a dict() or a list().)_GENERATION_MATCH_PARAMETERSr'rlistappenddictrN) parametersrrcamelcase_namer~s r+ruru7sr+G & $$^4  *d+!!>5"9:J--2 >*!K r*c td|jDdkDrM|jDcgc]}d|d }}dj|dd}|d}d|d|}t |ycc}w) zRaise ``ValueError`` exception if more than one parameter was set. :type error: :exc:`ValueError` :param error: Description of which fields were set :raises: :class:`~ValueError` containing the fields that were set c3$K|]}|du ywr$r)).0args r+ z._raise_if_more_than_one_set..[s 6s3d? 6s'rNrKzPass at most one of z and )sumvalueskeysrrN)kwargsrO escaped_keys keys_but_lastlast_keymsgs r+_raise_if_more_than_one_setrSs 6fmmo 66:06 >!D6 > > ,s"34 #$]O5 Co;>s A2cZt|}|jr|jr|S|d|S)a!Helper to build bucket bound hostname URL. :type host: str :param host: Host name. :type scheme: str :param scheme: (Optional) Web scheme. If passed, use it as a scheme in the result URL. :rtype: str :returns: A bucket bound hostname URL. z://)rr:r9)hostr: url_partss r+_bucket_bound_hostname_urlrfs4II,, XS r*c| | td|Atj|j|j|j |j S|tj|StjdS)a~Convert google.api.core.Retry to google.resumable_media.RetryStrategy. Custom predicates are not translated. :type retry: google.api_core.Retry :param retry: (Optional) The google.api_core.Retry object to translate. :type num_retries: int :param num_retries: (Optional) The number of retries desired. This is supported for backwards compatibility and is mutually exclusive with `retry`. :rtype: google.resumable_media.RetryStrategy :returns: A RetryStrategy with all applicable attributes copied from input, or a RetryStrategy with max_retries set to 0 if None was input. z6num_retries and retry arguments are mutually exclusive) max_sleepmax_cumulative_retry initial_delay multiplier) max_retriesr)rNr RetryStrategy_maximum _deadline_initial _multiplier)rs num_retriess r+(_api_core_retry_to_resumable_media_retryrzs|$ [4QRR  ,,nn!&..((    ,,EE,,;;r*c.dttzS)Nzgccl-invocation-id/)rrr)r*r+_get_invocation_idrs 3uw< //r*cN|dt}|r|d|z }dd||||xs|dS)aGet the headers for a request. :type user_agent: str :param user_agent: The user-agent for requests. :type command: str :param command: (Optional) Information about which interface for the operation was used, to be included in the X-Goog-API-Client header. Please leave as None unless otherwise directed. :rtype: dict :returns: The headers to be used for the request.  z gccl-gcs-cmd/zapplication/jsonz gzip, deflate)AcceptzAccept-Encodingz User-AgentzX-Goog-API-Clientz content-typezx-upload-content-type)r) user_agent content_typex_upload_content_typecommandx_goog_api_clients r+_get_default_headersrsR(&,a(:(<'=>~gY77%* .$!6!F,  r*)F)i r$)zapplication/json; charset=UTF-8NN)9rrdatetimehashlibrr% urllib.parserruuidrgoogler google.authrgoogle.cloud.storage.constantsr google.cloud.storage.retryr r r(r/_API_VERSION_OVERRIDE_ENV_VAR_DEFAULT_UNIVERSE_DOMAIN_STORAGE_HOST_TEMPLATEformatr1r0r. _API_VERSIONrr_NUM_RETRIES_MESSAGEnow_NOWtimezoneutc_UTCr,r2r4rArErIrPobjectrRrrrrvrurrrrrr)r*r+rs>  !#"(;4P3>!8O 6O+43::,;ryy6= -  :  D$[+V[+| &6* * 4$8& (