o Meq@sPdZddlmZddlmZddlmZddlmZedGdddeZ d S) z'Rectified Linear Unit activation layer.)backend)Layer)tf_utils) keras_exportzkeras.layers.ReLUcsFeZdZdZ d fdd ZddZfdd Zejd d Z Z S) ReLUaRectified Linear Unit activation function. With default values, it returns element-wise `max(x, 0)`. Otherwise, it follows: ``` f(x) = max_value if x >= max_value f(x) = x if threshold <= x < max_value f(x) = negative_slope * (x - threshold) otherwise ``` Usage: >>> layer = tf.keras.layers.ReLU() >>> output = layer([-3.0, -1.0, 0.0, 2.0]) >>> list(output.numpy()) [0.0, 0.0, 0.0, 2.0] >>> layer = tf.keras.layers.ReLU(max_value=1.0) >>> output = layer([-3.0, -1.0, 0.0, 2.0]) >>> list(output.numpy()) [0.0, 0.0, 0.0, 1.0] >>> layer = tf.keras.layers.ReLU(negative_slope=1.0) >>> output = layer([-3.0, -1.0, 0.0, 2.0]) >>> list(output.numpy()) [-3.0, -1.0, 0.0, 2.0] >>> layer = tf.keras.layers.ReLU(threshold=1.5) >>> output = layer([-3.0, -1.0, 1.0, 2.0]) >>> list(output.numpy()) [0.0, 0.0, 0.0, 2.0] Input shape: Arbitrary. Use the keyword argument `input_shape` (tuple of integers, does not include the batch axis) when using this layer as the first layer in a model. Output shape: Same shape as the input. Args: max_value: Float >= 0. Maximum activation value. Default to None, which means unlimited. negative_slope: Float >= 0. Negative slope coefficient. Default to 0. threshold: Float >= 0. Threshold value for thresholded activation. Default to 0. Nc stjdi||dur|dkrtd||dus |dkr'td||dus/|dkr6td|d|_|durBt|}||_t||_t||_dS)Nrz@max_value of a ReLU layer cannot be a negative value. Received: zEnegative_slope of a ReLU layer cannot be a negative value. Received: z@threshold of a ReLU layer cannot be a negative value. Received: T) super__init__ ValueErrorZsupports_maskingrZcast_to_floatx max_valuenegative_slope threshold)selfr r rkwargs __class__rLD:\Projects\ConvertPro\env\Lib\site-packages\keras/layers/activation/relu.pyr Ks2  z ReLU.__init__cCstj||j|j|jdS)N)alphar r)rZrelur r r)rZinputsrrrcallfs z ReLU.callcs8|j|j|jd}t}tt|t|S)N)r r r)r r rr get_configdictlistitems)rconfigZ base_configrrrrps  zReLU.get_configcCs|S)Nr)rZ input_shaperrrcompute_output_shapeyszReLU.compute_output_shape)Nrr) __name__ __module__ __qualname____doc__r rrrZshape_type_conversionr __classcell__rrrrrs0  rN) rZkerasrZkeras.engine.base_layerrZ keras.utilsrZ tensorflow.python.util.tf_exportrrrrrrs