Is it necessary that features in naive Bayes classifier are conditionally independent?

03 March 2013 1 2K Report

I want to understand that features can be dependent (unconditionally) to each other in naive Bayes classifier and must be conditionally independent?

Pekka Jounela

Mahdi, NB assumes feature independence and there are many semi-NB classifiers that alleviate the attribute interdependence problem of NB. See e.g. Zheng and Webb. Lazy learning of Bayesian rules. Machine Learning, 41 (1):53{84, 2000.

and

Zheng and Webb. A comparative study of seminaive bayes methods in classification learning. In Proceedings of the Fourth Australasian Data Mining Conference (AusDM05), pages 141-156, Sydney, 2005.

3rd Mar, 2013

Mahdi Manafzade

Ferdowsi University Of Mashhad

Thanks dudes but I mean which is correct in the original NB "conditionally independent or independent features". I think features must be conditionally independent and can be dependent unconditionally.

3rd Mar, 2013

Pekka Jounela

Natural Resources Institute Finland (Luke)

Precisely it is conditionally independent; see http://en.wikipedia.org/wiki/Conditional_independence

1 Recommendation

Can you help by adding an answer?

Answer

Badges
Science topic

More Mahdi Manafzade's questions See All

How to reduce dimensions for binary data?

I have binary data (0,1) with set dimensions (for example 400). My data matrix is 10000*400. I need to reduce dimensions for the binary data (100 dimension). Can I use PCA for the data? When I use...

08 September 2013 6,561 4 View

How can I compute the camera pose using relative rotation and translation matrix in RGBD images?

I have a kinect camera that can move around a certain object. I have computed 3d corresponding points in two consecutive images and got 3*3 rotation matrix and 3*1 translation matrix to convert...

07 August 2013 2,720 11 View

Introduce the best measure for image registration?

I have some images in different viewpoints. Suppose I want to register an image to another one. I extracted SURF features into both images and matched them together. I need to compare my method to...

07 August 2013 4,062 1 View

Support vectors in linear SVM

I know if we remove some non support vectors, then the discriminant line doesn't change - but by removing some support vectors, does it? If it does, does the margin width always increase or can...

01 February 2013 9,377 4 View

What are stable and unstable learning algorithms?

Please explain stable and unstable learning algorithms with examples and then categorize different classifiers into them. (For example NN, SVM, Linear classifier, FLD, KNN and decision tree are...

01 February 2013 5,886 7 View

Why should we choose deep learning to machine learning? Why is CNN better for image classification? Can I get Typical Answer?

What Characteristics makes CNN work better?

03 March 2021 1,458 4 View

What are some of the research gaps in machine learning and artificial intelligence in africa?

i would to know some of the research gaps in the artificial intelligence field in most african countries.

03 March 2021 6,145 3 View

Anyone plz suggest relevant topic for research in image processing+Deep learning.?

I have selected brain tumor images ...but now found that already lots of research done n this topic.

03 March 2021 5,774 3 View

How to increase a model accuracy ?

dear community, my model is based feature extraction from non stationary signals using discrete Wavelet Transform and then using statistical features then machine learning classifiers in order to...

03 March 2021 6,994 5 View

Can you share me how teacher education is managed in your respective national educational system?

I feel that the practice in teacher education in my country is below the expected performance level due to very poor management system. Hope I will learn something from your experiences.

02 March 2021 1,516 4 View

Can NFL theorem be valid in infinite search space in ML?

NFL theorem is valid for algorithms training in fixed training set. However, the general characteristic of algorithms in expanded or open dataset has not been proved yet. Could you show your...

01 March 2021 1,189 3 View

What is the difference between L1 and L2 regularization in machine learning?

L1 and L2 regularization

28 February 2021 4,187 3 View

How to eliminate Steady state error from Reinforcement learning genetic algorithm code?

The following code (see 1st 2 images attached) is used to produce PID controller values that are designed to control the system (G). The code finds the PID controller values (noted as k) by using...

28 February 2021 6,560 14 View

Is there any Machine Learning/AI algorithm that lets you predict with incomplete features without missing value imputation process?

For instance, the model is trained with A,B,C,D,E features to predict F target. Then, I want to make prediction on a new data, but with only A,C,D,E is known without doing missing value imputation...

28 February 2021 1,556 6 View

How can I represent SDS-PAGE results for machine learning analysis?

I am trying to classify and analyze the results of an SDS-PAGE based array for bacterial detection using machine learning, but I have trouble finding the best way to represent the results with...

27 February 2021 9,176 3 View