Alternative to back-propagation: Are there other popular alternatives to back-propagation through which a neural network can learn ?

More Titas De's questions See All

Support Vector Machines: How do I theoretically calculate the maximum number of support vectors required for a machine learning problem ?

For a machine learning problem, how do I theoretically calculate the maximum number of support vectors required to solve the machine learning problem ?

11 December 2019 6,823 8 View

Text Summarization: Are there standard NLP ( deep-learning ) techniques on paragraph summarization ?

Given a paragraph, are there standard techniques on paragraph summarization, like extracting relevant keywords. Anything in this direction will be help-ful

11 December 2019 2,679 6 View

Support Vector Machines: How to find the minimum number of support vectors for a machine learning classification problem ?

How do I theoretically calculate the minimum number of support vectors required to solve a machine learning problem ?

11 December 2019 9,129 7 View

Deep Learning - transfer learning from one image classification dataset to another - Scientific process ?

Hi, is there any quantifiable scientific process to understand whether a deep learning model trained on a certain image classification dataset can be used for transfer learning for image...

10 November 2019 5,614 2 View

Machine Learning: Given a classification dataset, how can we quickly figure out that our dataset is really noisy ?

How can we figure out that our dataset is really noisy - both in terms of the data-points and labels ?

10 November 2019 9,057 1 View

Machine Learning Classification: How can we derive to the (theoretical) minimum classification error ?

Given a dataset, is there a systematic way to come to a maximum classification accuracy, beyond which no algorithm or classifier can improve the accuracy ?

10 November 2019 7,882 7 View

Machine Learning: Say we are given a classification dataset. Is there any systematic way to reduce the noise in the training labels ?

Reduction of noise in training labels.

10 November 2019 5,982 3 View

Apart from Self-Organizing maps, what are the most common neural network techniques used for clustering ?

Clustering - Neural Netowrks

08 September 2018 4,811 4 View

A 10-layer ResNet CNN trained from scratch gives lower classification accuracy than the same without residual connections. Any possible reasons ?

CNNs, Deep Learning, ResNet, Residual Connections

06 July 2018 625 5 View

Regarding CNNs in deep learning, can anyone tell me in which cases transfer learning increases the error or decreases the accuracy ?

Deep Learning - Transfer Learning

06 July 2018 5,012 5 View

What is the most Operating System (OS) which can be INSTALL on Tiny hard devices like Raspberry Pi (RPi) hardware ?

I'm targeting to deploy a mesh network and manually configure MANET routing protocols. I'm preparing scenarios, architectures, and hard devices needed to do that. Are there some step-by-step...

03 March 2021 1,931 5 View

Why should we choose deep learning to machine learning? Why is CNN better for image classification? Can I get Typical Answer?

What Characteristics makes CNN work better?

03 March 2021 1,458 4 View

What are some of the research gaps in machine learning and artificial intelligence in africa?

i would to know some of the research gaps in the artificial intelligence field in most african countries.

03 March 2021 6,145 3 View

Anyone plz suggest relevant topic for research in image processing+Deep learning.?

I have selected brain tumor images ...but now found that already lots of research done n this topic.

03 March 2021 5,774 3 View

How to increase a model accuracy ?

dear community, my model is based feature extraction from non stationary signals using discrete Wavelet Transform and then using statistical features then machine learning classifiers in order to...

03 March 2021 6,994 5 View

Is there a powerful system for the security of the systems distributed on IoT systems?

02 March 2021 3,858 10 View

Can you share me how teacher education is managed in your respective national educational system?

I feel that the practice in teacher education in my country is below the expected performance level due to very poor management system. Hope I will learn something from your experiences.

02 March 2021 1,516 4 View

Can NFL theorem be valid in infinite search space in ML?

NFL theorem is valid for algorithms training in fixed training set. However, the general characteristic of algorithms in expanded or open dataset has not been proved yet. Could you show your...

01 March 2021 1,189 3 View

How to choose ANN number of hidden layers and nodes?

Hello, Could you please share any interesting research explaining how to choose the number of hidden layers and nodes per layer in case of regression problems using ANN? Thank you, any help would...

01 March 2021 6,200 3 View

What is the difference between L1 and L2 regularization in machine learning?

L1 and L2 regularization

28 February 2021 4,187 3 View

Fabrice Clerot

many pointers can be found here :

http://www.breloff.com/no-backprop/

http://www.breloff.com/no-backprop-part2/

and there always is the good old Hebb rule

https://www.ece.ucsb.edu/wcsl/people/aseem/Aseem_stuff/hebbian_preprint.pdf

Article Deep Learning With Asymmetric Connections and Hebbian Update...

also regarding BP through time

Preprint Biologically inspired alternatives to backpropagation throug...

now; i would not say these are "poipular" alternatives ... but these are definitely alternatives to BP learning.

Adnan Riaz

these are some alternatives to BP learning.

Shahbaa I. Khaleel

The Alternative to backpropagation through which a neural network can learn is the Elman neural network and Jordan neural network.

also there is many of learning rule to training neural network for example Hebbian learning , etc.

the attached file is contain many of learning rule.

Good luck

Samy Azer

Titas De-

Thank you for your excellent question. You may use genetic algorithm or other approaches- see the link below for abstracts-

https://www.sciencedirect.com/topics/engineering/genetic-algorithm

Titas De

Thank you Fabrice Clerot , Adnan Riaz , Shahbaa I. Khaleel and Samy Azer

Olawale Onabola

You may also check this paper from Google on approximate backprop

https://arxiv.org/abs/2001.06232