Numpy Tranpose Explained


(n,) vs. (n, 1)

Numpy arrays are set up so 0D arrays are scalars, 1D arrays are vectors, 2D arrays are matrices (and the linear map associated with them), and higher dimensional arrays are unimportant for this post.

This can be seen from the length of np.array(...).shape. np.array(1).shape is (), a zero length tuple, np.array([1]).shape is a length one tuple, and you get the idea from there.

Transposing

The transpose of a 1D array of shape (n,) is still a 1D array of the same shape, rather than a 2D array of shape (1,n). In other words, transposing 1D arrays doesn’t do anything.

This will only really make sense if you understand the transpose and its relationship to dual spaces.

Numpy uses the transpose only to express the transpose of a linear map, not as a handy way to get a linear functional (vector in the dual space) from your vector1. To do that, you have to explicitly make your vector into a linear map (of shape (n,1)) with reshape and then transpose.

In this way, Numpy draws a sharp line between vectors and the linear maps acting on them. All isomorphisms that allow you to conflate the two don’t fly in Numpy, so you’ll have to do the conversions explicitly2.

  1. Under the dual basis induced by whichever one you’re using to represent your original vector. 

  2. Which I’m personally a fan of when programming. 

Related Posts

Random Thought: LC Theorem

I finally have an answer to "who's your favorite singer?"

My Top Tip for Helping People Get Started Programming

GPT-f

Random paper on angles

An Image is Worth 16x16 Words

Random stuff

Lossless Data Compression with Neural Networks by Fabrice Bellard

Downscaling Numerical Weather Models With GANs (My CI 2019 Paper)

Learning Differential Forms and Questions