What are Tensor Diagrams?
Machine learning involves a lot of tensor manipulation, and it's easy to lose track of the bigger picture when manipulating high-dimensional data using notation designed for vectors and matrices.
It turns out all the trouble with tensors disappears when you instead represent them using graphs:
This book aims to standardize the notation for tensor diagrams by rewriting the classical "Matrix Cookbook" using this notation.
Tensor diagrams are better than alternative notation like Index Notation (einsum) because they:
- Make it easy to spot patterns and symmetries
- Avoid all trouble with vectorization and Kronecker products
- Make Matrix Calculus simple and intuitive
- Represent functions and broadcasting effortlessly
About the Book:
"The Tensor Cookbook" is a comprehensive guide to tensors, using the visual language of tensor diagrams. It closely follows the legendary "Matrix Cookbook" while providing a new way to understand and appreciate tensor operations through diagrams.
This book covers a wide range of topics, including:
- Introduction to tensor diagrams
- Simple and advanced derivatives
- Statistics and probability
- Kronecker and Vec operators
- Special matrices and decompositions
- Machine learning applications
- And much more!