Neurocomputing
○ Elsevier BV
Preprints posted in the last 90 days, ranked by how well they match Neurocomputing's content profile, based on 13 papers previously published here. The average preprint has a 0.02% match score for this journal, so anything above that is already an above-average fit.
Furuichi, S.; Kohno, T.
Show abstract
The brain is believed to process information efficiently in a different manner from deep learning-based artificial intelligence (AI). Brain-like next-generation AI is gaining attention owing to its potential to perform human-like, highly adaptive, robust, and power-efficient computation. To realize such AI, one crucial approach is the bottom-up implementation of the neuronal systems, capturing their electrophysiological characteristics in electronic circuits. However, this neuromorphic approach generally focuses on simplified neuronal models that do not refer to many biological findings. Developing closer-to-brain models is a natural direction that serve as a fundamental computing model for next-generation AI. One of the constraints of neuromorphic circuits is the bit resolution of synaptic efficacy memory, as the memory footprint scales with it precision. Although low-resolution synaptic efficacy is essential for minimizing memory circuit footprint and energy consumption, it generally leads to performance degradation in many tasks such as the spatio-temporal spike pattern detection. This study proposed a closer-to-brain learning rule that incorporates heterosynaptic plasticity (HP) induced by glutamate spillover. It is demonstrated that our model mitigates the performance degradation associated with low-bit resolution synaptic efficacy, achieving the pattern detection success rate with 3-bit resolution synaptic efficacy, which is comparable to 64-bit floating-point precision. Furthermore, the findings of the study indicate that HP based model accelerates the convergence of the synaptic effcacy and effectively potentiates the synapses relevant to the pattern detection while suppressing irrelevant ones, thereby promoting a bimodal distribution of synaptic efficacies. These findings may provide a basic framework for constructing an energy-efficient, brain-like next-generation AI that maintains high performance under hardware constraints.
Usuzaki, T.; Matsunbo, E.; Inamori, R.
Show abstract
Despite the remarkable progress of artificial intelligence represented by large language models, how AI technologies can contribute to the construction of evidence in evidence-based medicine (EBM) remains an overlooked issue. Now, we need an AI that can be compatible with EBM. In the present paper, we aim to propose an example analysis that may contribute to this approach using variable Vision Transformer.
Yokoyama, H.; Takeuchi, R.; Shimizu, S.
Show abstract
The primary objective of system neuroscience is to understand the functional mapping and its causation in the dynamics of the brain network. Some experimental and methodological studies suggest that functional modularity and its hierarchical information processing in the brain network are crucial to understanding the functional role of task-specific or state-specific information flow in the brain. However, because most of the established techniques for detecting effective network structures in the neuroscience research field are strongly based on the "Granger causality" perspective, existing causal discovery methods specified for brain network analysis cannot identify the causal hierarchy in the modular network in the brain due to spurious correlation issues and indistinguishability of causal direction under the Gaussianity of observational noise in a linear system. To address the issues, we developed a causal discovery method for synchronous neural dynamics, called the Jacobian-informed linear non-Gaussian acyclic model, "j-VAR-LiNGAM", by incorporating the information of the Jacobian matrix determined from a phase-coupled oscillator model estimated from observed neural data into the VAR-LiNGAM algorithms. The method was validated by showing that it could extract causal ordering in both synthetic data and empirical neural observed data. Moreover, by analyzing the observed neural oscillatory signals obtained from mice and humans, we confirmed that our method identified causally hierarchical structures in the brain, which aligned with the neurophysiological interpretations. These findings suggested that our proposed method can reveal the neural basis of hierarchical information processing in the brain network.
Lorenzi, R. M.; De Grazia, M.; Gandini Wheeler-Kingshott, C. A. M.; Palesi, F.; D'Angelo, E. U.; Casellato, C.
Show abstract
A mean field model (MFM) is a mesoscopic description of neuronal population dynamics that can reduce the complexity of neural microcircuits into equations preserving key functional properties. The generation of a MFM is a complex mathematical process that starts with the incorporation of single neuron input/output relationships and local connectivity. Once neuron electroresponsiveness and synaptic properties are defined, in principle, the process can be automatized. Here we develop a tool for automatic MFM derivation from biophysically grounded spiking networks (Auto-MFM) by performing micro-to-mesoscale parameter remapping, estimating input/output relationships specific for different neuronal populations (i.e., transfer functions), and optimizing transfer function parameters. Auto-MFM was tested using a spiking cerebellar circuit as a generative model. The cerebellar MFM derived with Auto-MFM accurately reproduced cerebellar population dynamics of the corresponding spiking network, matching mean and time-varying firing rates across a wide range of stimulation patterns. Auto-MFM allowed us to model and explore physiological and pathological circuit variants; indeed, it was used to map ataxia-related structural connectivity alterations of the cerebellar network, in which Purkinje cells with simplified dendritic structure altered the cerebellar connectivity. Furthermore, Auto-MFM was used to create a library of cerebellar MFMs by sweeping the level of the excitatory conductance at mossy fiber - granule cell synapse, which is altered in several neuropathologies. Auto-MFM is thus proving a flexible and powerful tool to generate region-specific MFMs of healthy and pathological brain networks to be embedded in brain digital models.
Pena Fernandez, M.; Lloret Iglesias, L.; Marco de Lucas, J.
Show abstract
AO_SCPLOWBSTRACTC_SCPLOWOne of the most compelling ideas for bridging neuroscience and artificial neural networks is the establishment of a framework based on three main components: network architecture, optimization mechanism, and loss (or objective) function to be minimized. While the first two components have been extensively explored, the definition of a loss or objective function in neuroscience has been addressed less thoroughly, often from perspectives such as predictive coding. In this work, we propose an elementary loss function grounded in the comparison of neuronal responses to two signals: an external one, used for learning, and an internal one, reflecting the acquired knowledge. The loss function is thus simply the basic difference between the two, which, in terms of logical signals, corresponds to a well-known non-linearly separable function: the XOR function. We illustrate with a computational example how a binarized image recognition algorithm can be straightforwardly implemented in an autoencoder, and we show how a neuronal motif organized around an inhibitory neuron could implement such XOR operation and provide a feedback signal that makes optimization possible.
Haga, T.
Show abstract
Hippocampus is known to replay activity patterns to recall and process memories, which is often related to Hopfield-type attractor dynamics. Another line of theoretical studies suggests that hippocampal replay prioritizes replay of experiences to accelerate value learning for efficient decision making. It is unknown how hippocampal attractor dynamics perform prioritized memory sampling, and more broadly, how we can consistently relate dynamical (bottom-up) and functional (top-down) theories of hippocampal replay. In this paper, we propose an extended Hopfield-type attractor network model with momentum, kinetic energy, and conservation of the total energy, which is called momentum Hopfield model. We show that our model can be interpreted as CA3-CA1 network model with intrinsic oscillation, and such network model reproduces hippocampal replay in 1-D and 2-D spatial structures. We also prove that our model functionally works as Markov-chain Monte Carlo sampling in which recall frequencies of memory patterns can be arbitrarily biased. Using this property, we implemented prioritized experience replay using our model, which actually accelerated reinforcement learning for spatial navigation. Our model explains how dynamics of hippocampal circuits realize efficient memory sampling, providing a theoretical link between dynamics and functions of hippocampal replay.
Pache, A.; van Rossum, M. C. W.
Show abstract
Synaptic plasticity is metabolically expensive, yet animals continuously update their internal models without exhausting energy reserves. However, when artificial neural networks are trained, the network parameters are typically updated on every sample that is presented, even if the sample was classified correctly. Inspired by the human negativity bias and error-related negativity, we propose memorized mistake-gated learning--a biologically plausible plasticity rule where synaptic updates are strictly gated by current and past classification errors. This reduces the number of updates the network needs to make by 50% [~] 80%. Mistake gating is particularly well suited in two cases: 1) For incremental learning where new knowledge is acquired on a background of pre-existing knowledge, 2) For online learning scenarios when data needs to be stored for later replay, as mistake-gating reduces storage buffer requirements. The algorithm can be implemented in a few lines of code, adds no hyper-parameters, and comes at negligible computational overhead. Learning on mistakes is an energy efficient and biologically relevant modification to commonly used learning rules that is well suited for continual learning.
Kubo, Y.
Show abstract
Equilibrium propagation (EP) is a biologically plausible alternative to backpropagation that has demonstrated competitive performance across a range of machine learning tasks. Recent work has extended EP to spiking neural networks (SNNs), leveraging leaky integrate-and-fire (LIF) neurons and spike-based plasticity rules to improve biological realism while maintaining strong performance. In this work, we propose an EP-based SNN framework that combines LIF neural dynamics with a predictive learning rule, replacing conventional spike-timing-dependent plasticity (STDP) with a learning rule more directly aligned with predictive coding principles. We evaluate the proposed model on multiple image classification benchmarks, including MNIST, KMNIST, and Fashion-MNIST, and compare its performance with a BP-trained LIF SNN baseline. Our results show that the proposed EP-based LIF model (EP+LIF) achieves competitive accuracy across datasets, with performance approaching that of the BP-trained counterpart (BP+LIF) while relying on a biologically motivated local learning rule. In addition, analysis of hidden-layer spiking activity reveals that EP+LIF produces more persistent hidden-state activity, whereas BP+LIF yields sparser spiking representations. These results demonstrate that predictive learning can support effective EP-based training in LIF spiking networks, while also highlighting differences in activity patterns that motivate future work on activity regulation and sparse spiking dynamics.
Hassanejad Nazir, A.; Hellgren Kotaleski, J.; Liljenström, H.
Show abstract
As social beings, humans make decisions partly based on social interaction. Observing the behavior of others can lead to learning from and about them, potentially increasing trust and prompting trust-based behavioral changes. Observation-based decision making involves different neural structures. The orbitofrontal cortex (OFC) and lateral prefrontal cortex (LPFC) are known as neural structures mainly involved in processing emotional and cognitive decision values, respectively, while the anterior cingulate cortex (ACC) plays a pivotal role as a social hub, integrating the afferent expectancy signals from OFC and LPFC. This paper presents a neurocomputational model of the interplay between observational learning and trust, as well as their role in individual decision-making. Our model elucidates and predicts the emotional and rational behavioral changes of an individual influenced by observing the action-outcome association of an alleged expert. We have modeled the neurodynamics of three cortical structures (OFC, LPFC, and ACC) and their interactions, where the neural oscillatory properties, modeled with Dynamic Bayesian Probability, represent the observers attitude towards the expert and the decision options. As an example of an everyday behavioral situation related to climate change, we use the choice of transportation between home and work. The EEG-like simulation outputs from our model represent the presumed brain activity of an individual making such a choice, assuming the decision-maker is exposed to social information.
Zbaranska, S.; Rajeev, A.; Josselyn, S.; Laschowski, B.
Show abstract
Improving long-term memory in artificial neural networks remains an open challenge. To address this, we developed a novel brain-inspired framework for memory prioritization based on the principle of emotional valence. Our framework includes: (i) a valence-weighted cross-entropy loss that scales the learning signal by the valence magnitude, analogous to neuromodulation; (ii) an amygdala-inspired module that learns high-dimensional valence embeddings; and (iii) a hippocampus-inspired module that integrates valence embeddings into the attention mechanism to modulate information retrieval. We demonstrated the generalization of our framework across spatial, episodic, and language-based memory tasks, consistently improving memory prioritization and long-term retention of high-salience information. In addition to improving long-term memory, we also showed that our framework can help mitigate the "lost-in-the-middle" problem in language modeling. More generally, this research provides further evidence of the potential of brain-inspired algorithms to advance the field of machine learning.
Turski, J.
Show abstract
In previous studies by the author on binocular vision with the asymmetric eye (AE), which models a healthy human eye with misaligned optical components, the results were primarily presented in the Rodrigues vector (RV) framework and supported by simulations and 3D visualizations in GeoGebras dynamic geometry environment. In this paper, the novel geometric kinematics of the human eye, that is, the eye with misaligned optics, and simplified assumptions about the eye rotations (the eyes translational movements are disregarded), are developed within the framework of rigid-body rotations. The originality of the analysis lies in a precise geometric decomposition of a full rotation of the eyes posture into a torsion-free rotation (the geodesic part) and a torsional rotation (the non-geodesic extension of the geodesic part). This decomposition is extended to the corresponding decomposition of the angular velocity. A novel derivation of the eyes angular velocity from the RV formulation of the eye kinematics is proposed.
Alsaiari, A.; Turki, T.; Taguchi, Y.-h.
Show abstract
Ovarian cancer is one of the gynecological cancer types, which, if metastasized and not detected early, can cause deaths among women. Therefore, there is a need to accurately predict drug responses to ovarian cancer. A gynecological pathologist inspects abnormality in tissues, followed by providing a report about patients; however, such a diagnostic process is (1) hard; (2) requires experience; and (3) time consuming. Moreover, existing tools are far from perfect. Hence, we present a computational pipeline to improve predicting drug response pertaining to ovarian cancer, derived as follows. First, we download digital pathology images pertaining to ovarian bevacizumab response from the cancer imaging archive repository. We employed histogram of oriented gradients to images, constructing feature vectors, provided to Fisher linear discriminant analysis to change the representation through dimensionality reduction. Then, we provide reduced-dimensionality data for regression analysis through support vector regression coupled with various kernels and calculating the area under the ROC curve (AUC). Experimental results against transformer-based models (ViT and Swin) and other deep learning (DL) models (VGG16, ResNet50, InceptionV3, MobileNetV2, and EfficientNetB6) demonstrate that our approach with radial kernel (named SVRD+R) yielded an AUC performance improvements of 17% against the best-performing transformer-based model (ViT) while obtaining an AUC performance improvements of 14.9% when compared against the best DL-based model (MobileNetV2). These results demonstrate the superiority and feasibility of our AI-based pipeline when tackling prediction problems pertaining to gynecologic cancer studies. MSC92B05; 68T09
Xu, Z.; Hong, B.; Li, L.; Xie, T.; Chen, Z.; Yao, H.; Zhang, T.
Show abstract
Electrophysiological data, which serve as a biological signal that bridges neural activity and behavioral tasks, provide an innovative approach to neuroscience research. In this study, we constructed a dataset that contains over 2000 neurons across 117 days recorded in 20 mice containing 28,573 trials. Data for 5 mice were collected from the Secondary Motor Cortex (M2) region 8 mice was derived from the Ventrolateral Striatum (VLS) and 7 mice were from Substantia Nigra pars Reticulata (SNR). We induced licking behavior in head-fixed mice by periodically delivering water through a spout while simultaneously recording spiking activity from three brain regions and behavior related electrical signals. This dataset ensures precise temporal alignment between neural activity and behavioral events, offering a robust foundation for investigating neural encoding mechanisms and simulation of neural activities. This dataset establishes a precise spike-to-event mapping, which enables high decoding accuracy using Multilayer Perceptron (MLP) and Support Vector Machine (SVM). It can serve as a high-quality benchmark for developing encoding and decoding algorithms in neural networks, particularly Spiking Neural Networks (SNNs).
Sivakumar, E.; Anand, A.
Show abstract
Computer vision and deep learning techniques, including convolutional neural networks (CNNs) and transformers, have increased the performance of medical image classification systems. However, training deep learning models using medical images is a challenging task that necessitates a substantial amount of annotated data. In this paper, we implement data augmentation strategies to tackle dataset imbalance in the VinDr-SpineXR dataset, which has a lower number of spine abnormality X-ray images compared to normal spine X-ray images. Geometric transformations and synthetic image generation using Generative Adversarial Networks are explored and applied to the abnormal classes of the dataset, and classifier performance is validated using VGG-16 and InceptionNet to identify the most effective augmentation technique. Additionally, we introduce a hybrid augmentation technique that addresses class imbalance, reduces computational overhead relative to a GAN-only approach, and achieves [~]99% validation accuracy with both classifiers across all three case studies.
Wu, Y.; Zhang, B.; Yan, Y.; Li, J.; Wu, Y.; Kim, S. S.; Huang, K.; Ye, Q.; Yu, Y.; Tong, G.
Show abstract
Melanocytes become cancerous, forming tumors that may invade and destroy the surrounding tissues. When melanocytes acquire invasive characteristics, the anchored melanoma begins to damage the normal cells. Therefore, early intervention and diagnosis are essential to avoid high morbidity and mortality in malignant melanoma. However, It is challenging to distinguish the difference between malignant melanoma and benign clump of melanocytes. Based on a data set of 10,000 melanocyte tumors, this paper develops a new model system to improve the accuracy of distinguishing between benign and malignant melanocytes. In the first stage, the original CNN architectures are used, such as ResNet18, ResNet50, VGG11, and VGG16. Synthetic medical images, generated via a Diffusion Model to extract informative features from the original dataset, are used to train the CNN architectures. This approach improves classification accuracy from 91.1% to 92.9%. In the second stage, the fully connected layer of each neural network is replaced with a high-level classifier, XGBoost, to perform secondary classification. This hybrid strategy further enhances performance, achieving up to 93.3% accuracy by using the synthetic images.
Geminiani, A.; Meier, J. M.; Perdikis, D.; Ouertani, S.; Casellato, C.; Ritter, P.; D'Angelo, E. U.
Show abstract
The impact of cellular activities on large-scale brain dynamics is thought to determine brain functioning and disease, yet the causal relationships of neural mechanisms across scales remain unclear. Recently, the cerebellum has been reported to affect whole-brain dynamics during sensorimotor integration. To disclose the underlying mechanisms, we have developed a multiscale digital brain co-simulator, in which a spiking neural network of the olivo-cerebellar microcircuit is embedded in a mouse virtual brain and wired with other nodes using an atlas-based long-range connectome. Parameters and bi-directional interfaces between the spiking olivo-cerebellar network and other rate-coded modules were tuned to match experimental data of primary sensory and motor cortex (M1 and S1) power spectral densities and neuronal spiking rates. Then, the role of the cerebellar circuitry on sensorimotor integration was analyzed by lesioning critical circuit connections in silico. Simulations showed that spike processing within the cerebellar circuit is key to explaining the gamma-band coherence between M1 and S1 during sensorimotor integration. These results provide a mechanistic explanation of how the cerebellum promotes the formation of sensorimotor contingencies in relevant cortical modules as the basis of its critical role in sensorimotor prediction. On a broader perspective, this modelling approach opens new perspectives for the multiscale investigation of brain physiological and pathological states in relation to specific cellular and microcircuit properties.
Sheng, X.; Liu, J.; Liang, J.; Zhang, Y.; Mondal, S.; Li, Y.; Zhang, T.; Liu, B.; Song, J.; Cai, H.
Show abstract
Network analysis of human brain connectivity provides a fundamental framework for identifying the neurobiological mechanisms that cause cognitive variations and neurological disorders. However, existing diagnostic models often treat structural connectivity (SC) as a fixed or optimal topological scaffold for functional connectivity (FC). This consequently overlooks the higher-order dependencies between brain regions that are critical for characterizing pathological alterations. Moreover, the distinct spatial organizations of SC and FC complicate their direct integration, as naive alignment methods may distort the inherent nonlinear patterns of brain connectivity. To address these limitations, we propose the Graph Diffusion Optimal Transport Network (GDOT-Net), which models disease-related topological evolution and achieves precise alignment between SC and FC. Unlike existing diffusion studies, the proposed model introduces an evolvable brain connectome modeling approach to infer the complex topological structure of brain networks, unveiling higher-order connectivity patterns linked to specific neuropsychiatric disorders. Furthermore, GDOT-Net incorporates a Pattern-Specific Alignment mechanism, leveraging optimal transport to align structural and functional topological representations in a geometry-aware manner. To capture nonlinear topological relationships between brain regions, a Neural Graph Aggregator Module was developed, which adaptively learns complex node interaction patterns in brain networks. By leveraging this module, GDOT-Net generates highly discriminative representations that form a robust basis for the precision diagnosis of brain disorders. Experiments on REST-meta-MDD and ADNI demonstrate that GDOT-Net surpasses SOTA methods in uncovering structural-functional misalignments and disorder-specific subnetworks. The source code is publicly available at this Link.
Degirmendereli, G. G.; Ahmadkhan, A.; Yarman Vural, F. T.
Show abstract
This study explores the hypothesis that the anatomical regions of the brain can be modeled as complementary and interconnected information sources. We propose a novel framework for analyzing the dynamics of these interacting information sources during cognitive tasks using information-theoretic measures. Specifically, we introduce dynamic and static entropy models to quantify the information content within individual anatomical regions, both over time and in relation to specific cognitive demands. Furthermore, we develop two network models based on the dynamic and static Kullback-Leibler (KL) divergence to characterize the regional interactions. Testing our models on fMRI data recorded during Complex Problem Solving (CPS) tasks reveals promising results. Entropy values successfully identify activated brain regions, consistent with the existing neuroscience literature. Furthermore, our Kullback-Leibler network models demonstrate high accuracy in distinguishing between the planning and execution phases of CPS, as well as in differentiating between expert and novice problem solvers. These findings suggest that our information-theoretic approach holds promise for identifying active brain regions, characterizing mental states, and elucidating brain networks associated with cognitive tasks.
Bassat, M.; Tesler, F.; Destexhe, A.
Show abstract
The awake brain is known to display asynchronous (AS) states during periods of attention and arousal, but the responsiveness properties of such states remain unclear. Here, we investigate this question using computational models of spiking networks of excitatory and inhibitory neurons, mimicking recurrently-connected networks in layer 2/3 of the cerebral cortex. The networks can generate a continuum of AS states, but with different responsiveness characteristics. By using a mean-field model to infer the dynamic properties of the system, we find that there are two families of AS states, which we call "underdamped" (UD) and "overdamped" (OD). Responsiveness is maximised at the transition between OD and UD states, which identifies a "working point" that may present advantageous computational properties.
Lavezzo, L.; Grandjean, D.; Delplanque, S.; Barcos-Munoz, F.; Borradori-Tolsa, C.; Scilingo, E. P.; Filippa, M.; Nardelli, M.
Show abstract
Synchrony is a key mechanism that builds up the foundations of human interactions. Quantifying the level of physiological synchronization that occurs during dyadic exchanges is essential to fully comprehend social phenomena. We present a new index to characterize the coupling of complex physiological dynamics: the optimized Multichannel Complexity Index (opMCI). We validated this approach using synthetic time series of two coupled Henon Maps, with four different coupling levels in unidirectional and bidirectional manners. We demonstrated that the opMCI method allows to effectively discern between all coupling levels. Then, we applied the opMCI metric on heart rate variability data collected from 37 parent-infant dyads, during shared reading and playing activities, in the framework of the Shared Emotional Reading (SHER) project, with the aim of assessing the effects of early intervention in preterm babies. Two groups presented preterm infants: an intervention group, who participated in a two-month shared reading program, and a control group, who practiced shared play activities. A full-term group provided additional control data. The opMCI values were significantly higher for the intervention dyads with respect to the other groups during the shared reading task, showing that an early reading intervention program could increase parent-infant synchrony in preterm babies.