o NeW=@sdZddlmZddlmZddlmZddlmZddlmZddlm Z ddlm Z dd l m Z dd l mZdd lmZed gd Gddde jZedgd Gddde ZdS)z Long Short-Term Memory V1 layer.) activations) constraints) initializers) regularizers) InputSpec)lstm) rnn_utils)RNN) tf_logging) keras_exportzkeras.layers.LSTMCell)v1cs@eZdZdZ              d fd d ZZS) LSTMCellaW Cell class for the LSTM layer. Args: units: Positive integer, dimensionality of the output space. activation: Activation function to use. Default: hyperbolic tangent (`tanh`). If you pass `None`, no activation is applied (ie. "linear" activation: `a(x) = x`). recurrent_activation: Activation function to use for the recurrent step. Default: hard sigmoid (`hard_sigmoid`). If you pass `None`, no activation is applied (ie. "linear" activation: `a(x) = x`). use_bias: Boolean, whether the layer uses a bias vector. kernel_initializer: Initializer for the `kernel` weights matrix, used for the linear transformation of the inputs. recurrent_initializer: Initializer for the `recurrent_kernel` weights matrix, used for the linear transformation of the recurrent state. bias_initializer: Initializer for the bias vector. unit_forget_bias: Boolean. If True, add 1 to the bias of the forget gate at initialization. Setting it to true will also force `bias_initializer="zeros"`. This is recommended in [Jozefowicz et al., 2015]( http://www.jmlr.org/proceedings/papers/v37/jozefowicz15.pdf) kernel_regularizer: Regularizer function applied to the `kernel` weights matrix. recurrent_regularizer: Regularizer function applied to the `recurrent_kernel` weights matrix. bias_regularizer: Regularizer function applied to the bias vector. kernel_constraint: Constraint function applied to the `kernel` weights matrix. recurrent_constraint: Constraint function applied to the `recurrent_kernel` weights matrix. bias_constraint: Constraint function applied to the bias vector. dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the inputs. recurrent_dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the recurrent state. Call arguments: inputs: A 2D tensor. states: List of state tensors corresponding to the previous timestep. training: Python boolean indicating whether the layer should behave in training mode or in inference mode. Only relevant when `dropout` or `recurrent_dropout` is used. tanh hard_sigmoidTglorot_uniform orthogonalzerosNc stj|fid|d|d|d|d|d|d|d| d | d | d | d | d |d|d|d|dd|dS)N activationrecurrent_activationuse_biaskernel_initializerrecurrent_initializerbias_initializerunit_forget_biaskernel_regularizerrecurrent_regularizerbias_regularizerkernel_constraintrecurrent_constraintbias_constraintdropoutrecurrent_dropoutimplementation)super__init__pop)selfunitsrrrrrrrrrrrrr r!r"kwargs __class__HD:\Projects\ConvertPro\env\Lib\site-packages\keras/layers/rnn/lstm_v1.pyr&TsH       zLSTMCell.__init__)rrTrrrTNNNNNNrr)__name__ __module__ __qualname____doc__r& __classcell__r-r-r+r.r s$5r zkeras.layers.LSTMcs>eZdZdZ               d5fd d Zd6fd d ZeddZeddZeddZ eddZ eddZ eddZ eddZ eddZedd Zed!d"Zed#d$Zed%d&Zed'd(Zed)d*Zed+d,Zed-d.Zed/d0Zfd1d2Zed3d4ZZS)7LSTMaTLong Short-Term Memory layer - Hochreiter 1997. Note that this cell is not optimized for performance on GPU. Please use `tf.compat.v1.keras.layers.CuDNNLSTM` for better performance on GPU. Args: units: Positive integer, dimensionality of the output space. activation: Activation function to use. Default: hyperbolic tangent (`tanh`). If you pass `None`, no activation is applied (ie. "linear" activation: `a(x) = x`). recurrent_activation: Activation function to use for the recurrent step. Default: hard sigmoid (`hard_sigmoid`). If you pass `None`, no activation is applied (ie. "linear" activation: `a(x) = x`). use_bias: Boolean, whether the layer uses a bias vector. kernel_initializer: Initializer for the `kernel` weights matrix, used for the linear transformation of the inputs.. recurrent_initializer: Initializer for the `recurrent_kernel` weights matrix, used for the linear transformation of the recurrent state. bias_initializer: Initializer for the bias vector. unit_forget_bias: Boolean. If True, add 1 to the bias of the forget gate at initialization. Setting it to true will also force `bias_initializer="zeros"`. This is recommended in [Jozefowicz et al., 2015]( http://www.jmlr.org/proceedings/papers/v37/jozefowicz15.pdf). kernel_regularizer: Regularizer function applied to the `kernel` weights matrix. recurrent_regularizer: Regularizer function applied to the `recurrent_kernel` weights matrix. bias_regularizer: Regularizer function applied to the bias vector. activity_regularizer: Regularizer function applied to the output of the layer (its "activation"). kernel_constraint: Constraint function applied to the `kernel` weights matrix. recurrent_constraint: Constraint function applied to the `recurrent_kernel` weights matrix. bias_constraint: Constraint function applied to the bias vector. dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the inputs. recurrent_dropout: Float between 0 and 1. Fraction of the units to drop for the linear transformation of the recurrent state. return_sequences: Boolean. Whether to return the last output in the output sequence, or the full sequence. return_state: Boolean. Whether to return the last state in addition to the output. go_backwards: Boolean (default False). If True, process the input sequence backwards and return the reversed sequence. stateful: Boolean (default False). If True, the last state for each sample at index i in a batch will be used as initial state for the sample of index i in the following batch. unroll: Boolean (default False). If True, the network will be unrolled, else a symbolic loop will be used. Unrolling can speed-up a RNN, although it tends to be more memory-intensive. Unrolling is only suitable for short sequences. time_major: The shape format of the `inputs` and `outputs` tensors. If True, the inputs and outputs will be in shape `(timesteps, batch, ...)`, whereas in the False case, it will be `(batch, timesteps, ...)`. Using `time_major = True` is a bit more efficient because it avoids transposes at the beginning and end of the RNN calculation. However, most TensorFlow data is batch-major, so by default this function accepts input and emits output in batch-major form. Call arguments: inputs: A 3D tensor. mask: Binary tensor of shape `(samples, timesteps)` indicating whether a given timestep should be masked. An individual `True` entry indicates that the corresponding timestep should be utilized, while a `False` entry indicates that the corresponding timestep should be ignored. training: Python boolean indicating whether the layer should behave in training mode or in inference mode. This argument is passed to the cell when calling it. This is only relevant if `dropout` or `recurrent_dropout` is used. initial_state: List of initial state tensors to be passed to the first call of the cell. rrTrrrNrFc s|dd}|dkrtdd|vrd|di}ni}t|fid|d|d|d |d |d |d |d | d| d| d| d|d|d|d|d|d|dd|dd|}tj|f|||||d|t| |_t ddg|_ dS)Nr#r$rzm`implementation=0` has been deprecated, and now defaults to `implementation=1`.Please update your layer call.Zenable_caching_devicerrrrrrrrrrrrr r!r"ZdtypeZ trainableT)return_sequences return_state go_backwardsstatefulunroll)ndim) r'loggingwarningr getr%r&ractivity_regularizerrZ input_spec)r(r)rrrrrrrrrrr?rrr r!r"r5r6r7r8r9r*r#Z cell_kwargscellr+r-r.r&s|          z LSTM.__init__cstj||||dS)N)masktraining initial_state)r%call)r(ZinputsrArBrCr+r-r.rDsz LSTM.callcC|jjSN)r@r)r(r-r-r.r)#z LSTM.unitscCrErF)r@rrGr-r-r.r'rHzLSTM.activationcCrErF)r@rrGr-r-r.r+rHzLSTM.recurrent_activationcCrErF)r@rrGr-r-r.r/rHz LSTM.use_biascCrErF)r@rrGr-r-r.r3rHzLSTM.kernel_initializercCrErF)r@rrGr-r-r.r7rHzLSTM.recurrent_initializercCrErF)r@rrGr-r-r.r;rHzLSTM.bias_initializercCrErF)r@rrGr-r-r.r?rHzLSTM.unit_forget_biascCrErF)r@rrGr-r-r.rCrHzLSTM.kernel_regularizercCrErF)r@rrGr-r-r.rGrHzLSTM.recurrent_regularizercCrErF)r@rrGr-r-r.rKrHzLSTM.bias_regularizercCrErF)r@rrGr-r-r.rOrHzLSTM.kernel_constraintcCrErF)r@rrGr-r-r.rSrHzLSTM.recurrent_constraintcCrErF)r@r rGr-r-r.r WrHzLSTM.bias_constraintcCrErF)r@r!rGr-r-r.r![rHz LSTM.dropoutcCrErF)r@r"rGr-r-r.r"_rHzLSTM.recurrent_dropoutcCrErF)r@r#rGr-r-r.r#crHzLSTM.implementationcsid|jdt|jdt|jd|jdt|jdt|jdt|j d|j d t |j d t |j d t |jd t |jd t|jdt|jdt|jd|jd|jd|ji}|t|jt}|d=tt|t|S)Nr)rrrrrrrrrrr?rrr r!r"r#r@) r)r serializerrrrrrrrrrrrr?rrrr r!r"r#updaterZ config_for_enable_caching_devicer@r% get_configdictlistitems)r(configZ base_configr+r-r.rKgsn       " zLSTM.get_configcCs*d|vr|ddkrd|d<|di|S)Nr#rr$r-r-)clsrOr-r-r. from_configszLSTM.from_config)rrTrrrTNNNNNNNrrFFFFF)NNN)r/r0r1r2r&rDpropertyr)rrrrrrrrrrrrr r!r"r#rK classmethodrQr3r-r-r+r.r4~s|XI                  (r4N)r2ZkerasrrrrZkeras.engine.input_specrZkeras.layers.rnnrrZkeras.layers.rnn.base_rnnr Ztensorflow.python.platformr r<Z tensorflow.python.util.tf_exportr r r4r-r-r-r.s            ]