Higher Structures in Deep Learning

arXiv:2609.00472v1 Announce Type: cross Abstract: We provide an expository introduction on the importance of higher-arity tensor operations to deep learning.

Then, we conduct a novel empirical investigation of higher-arity phenomenon in trained neural networks, introduce a hypergraphical generalization of the multilayer perceptron, and explore connections to evolutionary algorithms.

We conclude with a discussion of promising directions for future research.