Very cool. A question and a comment:

- What about higher(>3)-rank tensors?

- It's not clear to me what distinguishes your picture for a convolution layer from any other tensor of the same shape. Would be nice to visualize the filters/kernels somehow.