Hello,
I’ve been working with tf.keras.layers.Dense in tf 2.3 and obtained some strange weights after initialization. With input 63 and output 128 I expected uniform weights from -0.177 to 0.177 following Glorot Uniform initializer (tf.keras.layers.Dense | TensorFlow v2.3.0) but I obtained values between -0.4 and 0.4.
I obtained an histogram from weights and my suspiction is it has been initialized following Glorot Normal instead of Glorot Uniform:
Any idea if it is a known bug?