Basic : Mini-Batch in Dense Layer

Mini-Batch in Dense Layer

shape?

calculation?

output?

$l_{\overrightarrow{v}}$ : The length of v Vector

$n_{\overrightarrow{v}}$ : The number of v Vector

$i_{(l_{\overrightarrow{v}})}$ : The index of (the length of v Vector)

$m^{[from]}_{coordinate}$ : The element of M Marix

The length of

Passing through the layers, Dense Layer converts the columns of the Materix, from the number of x Vector to the number of $\nu$ Vector.

You have to observe the shape.

The Activation is one-to-one correspondence. The shape do not change.

So. in a column, as neuron-wise, the same neuron
And, in a row, as Batch-wise, the same layer

Batch is the set of data, X Matrix

Cascaded Dense Layer

I think that it is much more proper to count neurons using not length but number because neurons are indenpendent each other like the relations among the x vectors of the X matrix.