Title: Information flow in multilayer perceptrons: an in-depth analysis Show Chinese title

Title: 多层感知机中的信息流：深入分析

Abstract: Analysing how information flows along the layers of a multilayer perceptron is a topic of paramount importance in the field of artificial neural networks. After framing the problem from the point of view of information theory, in this position article a specific investigation is conducted on the way information is processed, with particular reference to the requirements imposed by supervised learning. To this end, the concept of information matrix is devised and then used as formal framework for understanding the aetiology of optimisation strategies and for studying the information flow. The underlying research for this article has also produced several key outcomes: i) the definition of a parametric optimisation strategy, ii) the finding that the optimisation strategy proposed in the information bottleneck framework shares strong similarities with the one derived from the information matrix, and iii) the insight that a multilayer perceptron serves as a kind of "adaptor", meant to process the input according to the given objective. Show Chinese abstract

Abstract: 分析多层感知器各层之间的信息流动是一个在人工神经网络领域至关重要的主题。 从信息论的角度阐述了这个问题之后，本文对信息处理的方式进行了具体研究，特别关注监督学习所施加的要求。 为此，设计了信息矩阵的概念，并将其用作理解优化策略病因和研究信息流动的正式框架。 本文的研究还产生了几个关键结果：i) 参数化优化策略的定义，ii) 发现信息瓶颈框架中提出的优化策略与从信息矩阵中推导出的策略有很强的相似性，iii) 洞察到多层感知器作为一种“适配器”，旨在根据给定目标处理输入。