Tensor network theory

For the tensor network theory used in quantum physics, see Tensor network.

Tensor network theory is a theory of brain function (particularly that of the cerebellum) that provides a mathematical model of the transformation of sensory space-time coordinates into motor coordinates and vice versa by cerebellar neuronal networks. The theory was developed by Andras Pellionisz and Rodolfo Llinas in the 1980s as a geometrization of brain function (especially of the central nervous system) using tensors.^[1][2]

Metric tensor that transforms input covariant tensors into output contravariant tensors. These tensors can be used to mathematically describe cerebellar neuronal network activities in the central nervous system.

History

Neuronal network schematic. The sensory inputs get transformed by the hidden layer representing the central nervous system which in turn outputs a motor response.

Geometrization movement of the mid-20th century

The mid-20th century saw a concerted movement to quantify and provide geometric models for various fields of science, including biology and physics.^[3][4][5] The geometrization of biology began in the 1950s in an effort to reduce concepts and principles of biology down into concepts of geometry similar to what was done in physics in the decades before.^[3] In fact, much of the geometrization that took place in the field of biology took its cues from the geometrization of contemporary physics.^[6] One major achievement in general relativity was the geometrization of gravitation.^[6] This allowed the trajectories of objects to be modeled as geodesic curves (or optimal paths) in a Riemannian space manifold.^[6] During the 1980s, the field of theoretical physics also witnessed an outburst of geometrization activity in parallel with the development of the Unified Field Theory, the Theory of Everything, and the similar Grand Unified Theory, all of which attempted to explain connections between known physical phenomena.^[7]

The geometrization of biology in parallel with the geometrization of physics covered a multitude of fields, including populations, disease outbreaks, and evolution, and continues to be an active field of research even today.^[8][9] By developing geometric models of populations and disease outbreaks, it is possible to predict the extent of the epidemic and allow public health officials and medical professionals to control disease outbreaks and better prepare for future epidemics.^[8] Likewise, there is work being done to develop geometric models for the evolutionary process of species in order to study the process of evolution, the space of morphological properties, the diversity of forms and spontaneous changes and mutations.^[9]

Geometrization of the brain and tensor network theory

Around the same time as all of the developments in the geometrization of biology and physics, some headway was made in the geometrization of neuroscience. At the time, it became more and more necessary for brain functions to be quantified in order to study them more rigorously. Much of the progress can be attributed to the work of Pellionisz and Llinas and their associates who developed the tensor network theory in order to give researchers a means to quantify and model central nervous system activities.^[1][2]

In 1980, Pellionisz and Llinas introduced their tensor network theory to describe the behavior of the cerebellum in transforming afferent sensory inputs into efferent motor outputs.^[1] They proposed that intrinsic multidimensional central nervous system space could be described and modeled by an extrinsic network of tensors that together describe the behavior of the central nervous system.^[1] By treating the brain as a "geometrical object" and assuming that (1) neuronal network activity is vectorial and (2) that the networks themselves are organized tensorially, brain function could be quantified and described simply as a network of tensors.^[1][2]

• Sensory input = covariant tensor
• Motor output = contravariant tensor
• Cerebellar neuronal network = metric tensor that transforms the sensory input into the motor output

Example

Six rotational axes about which the extraocular muscles turn the eye and the three rotational axes about which the vestibular semicircular canals measure head-movement. According to tensor network theory, a metric tensor can be determined to connect the two coordinate systems.

Vestibulo-ocular reflex

In 1986, Pellionisz described the geometrization of the "three-neuron vestibulo-ocular reflex arc" in a cat using tensor network theory.^[10] The "three-neuron vestibulo-ocular reflex arc" is named for the three neuron circuit the arc comprises. Sensory input into the vestibular system (angular acceleration of the head) is first received by the primary vestibular neurons which subsequently synapse onto secondary vestibular neurons.^[10] These secondary neurons carry out much of the signal processing and produce the efferent signal heading for the oculomotor neurons.^[10] Prior to the publishing of this paper, there had been no quantitative model to describe this "classic example of a basic sensorimotor transformation in the central nervous system" which is precisely what tensor network theory had been developed to model.^[10]

Here, Pellionisz described the analysis of the sensory input into the vestibular canals as the covariant vector component of tensor network theory. Likewise, the synthesized motor response (reflexive eye movement) is described as the contravariant vector component of the theory. By calculating the neuronal network transformations between the sensory input into the vestibular system and the subsequent motor response, a metric tensor representing the neuronal network was calculated.^[10]

The resulting metric tensor allowed for accurate predictions of the neuronal connections between the three intrinsically orthogonal vestibular canals and the six extraocular muscles that control the movement of the eye.^[10]

Applications

Neural Networks and Artificial Intelligence

Neural networks modeled after the activities of the central nervous system have allowed researchers to solve problems impossible to solve by other means. Artificial neural networks are now being applied in various applications to further research in other fields. One notable non-biological application of the tensor network theory was the simulated automated landing of a damaged F-15 fighter jet on one wing using a "Transputer parallel computer neural network".^[11] The fighter jet's sensors fed information into the flight computer which in turn transformed that information into commands to control the plane's wing-flaps and ailerons to achieve a stable touchdown. This was synonymous to sensory inputs from the body being transformed into motor outputs by the cerebellum. The flight computer's calculations and behavior was modeled as a metric tensor taking the covariant sensor readings and transforming it into contravariant commands to control aircraft hardware.^[11]

References

1. Pellionisz, A., Llinás, R. (1980). "Tensorial Approach To The Geometry Of Brain Function: Cerebellar Coordination Via A Metric Tensor" (PDF). Neuroscience. 5 (7): 1125––1136. doi:10.1016/0306-4522(80)90191-8. PMID 6967569. S2CID 17303132.^{[dead link‍]}
2. Pellionisz, A., Llinás, R. (1985). "Tensor Network Theory Of The Metaorganization Of Functional Geometries In The Central Nervous System". Neuroscience. 16 (2): 245–273. doi:10.1016/0306-4522(85)90001-6. PMID 4080158. S2CID 10747593.^{[dead link‍]}
3. Rashevsky, N (1956). "The Geometrization of Biology". Bulletin of Mathematical Biophysics. 18: 31–54. doi:10.1007/bf02477842.
4. Palais, Richard (1981). "The Geometrization of Physics" (PDF): 1–107. {{cite journal}}: Cite journal requires |journal= (help)
5. Mallios, Anastasios (August 2006). "Geometry and physics of today". International Journal of Theoretical Physics. 45 (8): 1552–1588. arXiv:physics/0405112. doi:10.1007/s10773-006-9130-3. S2CID 17514844.
6. Bailly, Francis (2011). Mathematics and the Natural Sciences: The Physical Singularity of Life. Imperial College Press. ISBN 978-1848166936.
7. KALINOWSKI, M (1988). "The Program of Geometrization of Physics: Some Philosophical Remarks". Synthese. 77 (2): 129–138. doi:10.1007/bf00869432. S2CID 46977351.
8. Kahil, M (2011). "Geometrization of Some Epidemic Models". Wseas Transactions on Mathematics. 10 (12): 454–462.
9. Nalimov, W (2011). "Geometrization of biological ideas: probabilistic model of evolution". Zhurnal Obshchei Biologii. 62 (5): 437–448. PMID 11605554.
10. Pellionisz, Andras; Werner Graf (October 1986). "Tensor Network Model of the "Three-Neuron Vestibulo-Ocular Reflex-Arc" in Cat". Journal of Theoretical Neurobiology. 5: 127–151.
11. Pellionisz, Andras (1995). "Flight Control by Neural Nets: A Challenge to Government/Industry/Academia". International Conference on Artificial Neural Networks.

External links

• Andras Pellionisz Google Scholar page Page