Results of the summarizing process for the arXiv paper: 2605.08176v1

, , , , In this study, we introduce DynPMNNs, a novel continuous-time deep learning architecture that incorporates ODEs in each hidden layer. Unlike traditional feed-forward networks with static activation functions, DynPMNNs utilize time-evolving dynamical systems, offering a biologically inspired perspective on hidden-layer behavior and enabling the integration of physically meaningful models. The framework is rooted in RKBSs, allowing DynPMNNs to be viewed as finite-dimensional solutions of an abstract training problem and revealing structural connections with conventional neural networks. Our work demonstrates how physics-modeled neural architectures can be interpreted as finite-dimensional realizations derived from infinite-dimensional variational formulations within RKBSs. This sheds light on the relationship between classical fully connected networks and DynPMNNs, emphasizing how replacing static activation functions with solution maps of initial value problems represents a genuine extension of standard neural architectures. We implement the DynPMNN framework using biophysical neuron models, specifically focusing on the FitzHugh–Nagumo system. By integrating an explicit Euler scheme into the forward pass, we create an Euler block that corresponds to the number of integration steps and naturally induces residual connections within the network structure. Through numerical experiments conducted on datasets such as the California Housing dataset, we compare DynPMNNs with Neural ODEs (NODEs) and Closed-form Continuous-Time Networks (CfCs). Despite utilizing fewer trainable parameters, DynPMNNs exhibit competitive performance. Overall, our results position DynPMNNs as a principled bridge between dynamical systems and deep learning research.

• - DynPMNNs are a novel continuous-time deep learning architecture that incorporates ODEs in each hidden layer
• - Unlike traditional feed-forward networks, DynPMNNs utilize time-evolving dynamical systems for hidden-layer behavior
• - The framework is rooted in RKBSs, allowing DynPMNNs to be viewed as finite-dimensional solutions of an abstract training problem
• - Implementing the DynPMNN framework using biophysical neuron models like the FitzHugh–Nagumo system shows competitive performance with fewer trainable parameters compared to NODEs and CfCs

Summary1. DynPMNNs are a new type of deep learning model that uses special equations in each hidden layer to learn. 2. These models are different from regular ones because they use dynamic systems that change over time for their behavior. 3. They are based on a mathematical concept called RKBSs, which helps them solve problems efficiently. 4. By using specific neuron models like FitzHugh–Nagumo system, DynPMNNs can perform well with fewer adjustable settings than other similar models. 5. Overall, DynPMNNs are smart and efficient tools for learning complex tasks. Definitions- Deep learning: A type of machine learning where computers learn to do tasks by imitating the human brain's structure and function. - ODEs (Ordinary Differential Equations): Mathematical equations that describe how one or more variables change over time. - Dynamical systems: Systems that change or evolve over time according to certain rules or equations. - Finite-dimensional: Refers to spaces or structures with a limited number of dimensions or parameters. - Neuron models: Mathematical representations of how individual nerve cells in the brain work and interact with each other.

Introduction: Deep learning has revolutionized the field of artificial intelligence and has shown great success in various applications such as image recognition, natural language processing, and speech recognition. However, traditional deep neural networks have limitations when it comes to modeling time-dependent data or incorporating physical laws into their architecture. In this research paper, the authors introduce DynPMNNs (Dynamic Physics-Modeled Neural Networks), a novel continuous-time deep learning architecture that integrates ordinary differential equations (ODEs) in each hidden layer. This article will provide a detailed overview of the study and its findings. Background: Traditional feed-forward neural networks use static activation functions to transform input data into output predictions. These networks are limited in their ability to model time-dependent data because they do not consider the dynamics of the underlying system. On the other hand, ODEs are commonly used in physics to model systems that change over time. By incorporating ODEs into neural network architectures, DynPMNNs offer a biologically inspired perspective on hidden-layer behavior and enable the integration of physically meaningful models. Methodology: The framework for DynPMNNs is rooted in Reproducing Kernel Banach Spaces (RKBS), which allows them to be viewed as finite-dimensional solutions of an abstract training problem. This reveals structural connections with conventional neural networks and sheds light on how replacing static activation functions with solution maps of initial value problems represents an extension of standard architectures. To implement DynPMNNs, biophysical neuron models were used, specifically focusing on the FitzHugh-Nagumo system. The authors also introduced an explicit Euler scheme into the forward pass, creating an Euler block that corresponds to the number of integration steps within each layer. This naturally induces residual connections within the network structure. Experiments: To evaluate their proposed method, numerical experiments were conducted on datasets such as California Housing dataset using different architectures including NODEs (Neural ODEs) and CfCs (Closed-form Continuous-Time Networks). Despite using fewer trainable parameters, DynPMNNs showed competitive performance compared to these traditional architectures. Results: The results of the experiments demonstrate that DynPMNNs are a principled bridge between dynamical systems and deep learning research. By incorporating ODEs into neural network architectures, they offer a more biologically inspired approach and can better model time-dependent data. Additionally, their use of RKBS allows for a deeper understanding of the relationship between traditional fully connected networks and DynPMNNs. Conclusion: In conclusion, this study introduces DynPMNNs as a novel continuous-time deep learning architecture that incorporates ODEs in each hidden layer. By integrating physics-based models into neural networks, DynPMNNs offer a more biologically inspired perspective on hidden-layer behavior and enable the integration of physically meaningful models. The results of this study position DynPMNNs as a promising direction for future research in bridging the gap between dynamical systems and deep learning.