A reduced-memory multi-layer perceptron withsystematic network weights generated and trainedthrough distribution hyper-parameters
Ahmad, S.; Vinayak, N.
Show abstract
A multi-layer perceptron (MLP) consists of a number of forward-connected weights (Wijk) from each feeding layer node (nij) to the many initially equivalent nodes (ni+1,k) in the next layer. Exact a priori order and search space of these weights (Wijk) is random and prone to redundancy, irreproducibility and non-optimality. We demonstrate that a weight subspace (Wijk for each i and j), generated systematically using a statistical distribution with predefined breakpoints and Genetic algorithm-trained hyper-parameters substantially reduces the computational complexity of an MLP and produces comparable or better performance than similarly trained equivalent models with fully defined weights. This distribution based neural network (DBNN) provides a novel framework to create very large neural network models with currently prohibitive memory requirements.
Matching journals
The top 10 journals account for 50% of the predicted probability mass.
Similar papers in this journal
Similar papers in this journal
- EnGRNT: Inference of gene regulatory networks using ensemble methods and topological feature extraction 95%
- An Inexpensive Smartphone-Based Device and Predictive Models for Rapid, Non-Invasive, and Point-of-Care Monitoring of Ocular and Cardiovascular Complications Related to Diabetes 92%
- Predicting the Epidemic Curve of the Coronavirus (SARS-CoV-2) Disease (COVID-19) Using Artificial Intelligence 92%
Similar papers in this journal
- A machine-learning Approach for Stress Detection Using Wearable Sensors in Free-living Environments 96%
- Decoding Clinical Biomarker Space of COVID-19: Exploring Matrix Factorization-based Feature Selection Methods 95%
- Identification of Myocardial Infarction (MI) Probability from Imbalanced Medical Survey Data: An Artificial Neural Network (ANN) with Explainable AI (XAI) Insights 94%
Similar papers in this journal
Similar papers in this journal
- A Convolution Based Computational Approach Towards DNA N6-methyladenine Site Identification and Motif Extraction in Rice Genome 95%
- A Robust Spike Sorting Method based on the Joint Optimization of Linear Discrimination Analysis and Density Peaks 95%
- A novel interpretable deep transfer learning combining diverse learnable parameters for improved T2D prediction based on single-cell gene regulatory networks 95%
"Similar papers" are the closest papers from that journal in the model's embedding space. They show what the match is built on, but the ranking comes mostly from a classifier over the whole training set, not from these examples alone.