Are non-binary features in deep belief networks possible?

04 April 2014 1 510 Report

Usually (as far as i now) Bernoulli-Bernoulli RBM are used in a DBN to make higher level binary features. Is there any work that tried to make these features continued values?

Andreas Merentitis

Yes there is also some work for this. For a practical guide in training RBMs have a look at:

http://www.cs.toronto.edu/~hinton/absps/guideTR.pdf

It has also references to the papers that have used each variation and some discussion on which problems best fit every type of architecture, what are the challenges assosiated with them, etc.

Badges
Science topic

More Aymen Cherif's questions See All

How the gradient is computed in an autoecoder with teid weights ?

With tied weight i mean the Weight matrix of the decoder is the transopse of the weight matrix of the encoder.

08 September 2014 4,313 0 View

What is an Extreme Learning Machine?

Can anyone give me any rapid explanation?

04 May 2014 3,122 1 View

What is the most Operating System (OS) which can be INSTALL on Tiny hard devices like Raspberry Pi (RPi) hardware ?

I'm targeting to deploy a mesh network and manually configure MANET routing protocols. I'm preparing scenarios, architectures, and hard devices needed to do that. Are there some step-by-step...

03 March 2021 1,931 5 View

Why should we choose deep learning to machine learning? Why is CNN better for image classification? Can I get Typical Answer?

What Characteristics makes CNN work better?

03 March 2021 1,458 4 View

What are some of the research gaps in machine learning and artificial intelligence in africa?

i would to know some of the research gaps in the artificial intelligence field in most african countries.

03 March 2021 6,145 3 View

Anyone plz suggest relevant topic for research in image processing+Deep learning.?

I have selected brain tumor images ...but now found that already lots of research done n this topic.

03 March 2021 5,774 3 View

How to increase a model accuracy ?

dear community, my model is based feature extraction from non stationary signals using discrete Wavelet Transform and then using statistical features then machine learning classifiers in order to...

03 March 2021 6,994 5 View

Is there a powerful system for the security of the systems distributed on IoT systems?

02 March 2021 3,858 10 View

Can you share me how teacher education is managed in your respective national educational system?

I feel that the practice in teacher education in my country is below the expected performance level due to very poor management system. Hope I will learn something from your experiences.

02 March 2021 1,516 4 View

Can NFL theorem be valid in infinite search space in ML?

NFL theorem is valid for algorithms training in fixed training set. However, the general characteristic of algorithms in expanded or open dataset has not been proved yet. Could you show your...

01 March 2021 1,189 3 View

How to choose ANN number of hidden layers and nodes?

Hello, Could you please share any interesting research explaining how to choose the number of hidden layers and nodes per layer in case of regression problems using ANN? Thank you, any help would...

01 March 2021 6,200 3 View

What is the difference between L1 and L2 regularization in machine learning?

L1 and L2 regularization

28 February 2021 4,187 3 View