How to address the Markov Decision Process (MDP) state space explosion problem for a larger system?

More Abhijeet Sahu's questions See All

How to compare two groups with only two measurements?

Hiiiii everyone! I have an enquiry on statistical analysis. I was looking for many forum and it's still cannot solve my problem. I want to compare means of two groups of data but only with two...

03 March 2021 8,796 3 View

Hello fellow researcher .. What is the meaning of your name?

I would like to create a small guide containing the meanings of the names .. Thanks to everyone who cooperates with me in achieving it.

03 March 2021 5,266 4 View

Is There Any Feasible Method To Test Fluorescent Compounds Other Than Fluorescence Spectrometers ??

Is There Any Feasible Method To Test The Efficiency Of Fluorescent Compounds Other Than UV Spectrometers ? Suggestions Would Be Appreciated !

02 March 2021 5,785 3 View

Is it possible to do piezoelectric coupling in ANSYS-APDL or COMSOL between tapered substrate and rectangular piezoelectric patch?

How to do Piezoelectric coupling in ANSYS-APDL or COMSOL between tapered substrate and rectangular piezoelectric patch? Piezoelectric coupling between the rectangular substrate and rectangular...

02 March 2021 9,833 3 View

Does anyone know HRM channel in a 2 plex QIAGEN Rotor- Gene Q qPCR can be used as a separate channel?

I am going to have 3 different probes in my qPCR work that I am going to do. But I realized that the machine we have in the lab is a Rotor-Gene Q 2plex HRM Platform, saying it has green, yellow,...

01 March 2021 8,544 1 View

Adherance of Polyaniline coating over stainless steel?

Is the electropolymerisation of polyaniline coating over stainless steel (SS) via Cyclic voltammetry technique is really adherant? Else how to improve the adhesion of the coating, whether any...

01 March 2021 8,220 2 View

How can you bring two structures together to create an adhesive bond in LAMMPS?

I have created an Ice 1h crystalline structure and an Aluminium substrate structure and equilibrated both at 250K. Now I need to bring them together in a way that an adhesive bond is created....

01 March 2021 3,325 2 View

No title

Does anyone have the experience of using Taq Man probes in the QIAGEN Rotar- Gene qPCR machine?

01 March 2021 5,311 1 View

Why is the sum of the elements in a row in a Q matrix equal to zero?

When explaining substitution models, the substitutions are expressed as Q matrix. Why is the sum of the elements in a row zero?

28 February 2021 3,864 3 View

How to model the battery pack in PSIM or PSCAD?

Hello, I have simulated a single battery cell using Thevenin equivalent circuit. For a battery pack, I have a large number of cells connected in series and parallel connections. Is there any way...

28 February 2021 2,116 1 View

Why should we choose deep learning to machine learning? Why is CNN better for image classification? Can I get Typical Answer?

What Characteristics makes CNN work better?

03 March 2021 1,458 4 View

What are some of the research gaps in machine learning and artificial intelligence in africa?

i would to know some of the research gaps in the artificial intelligence field in most african countries.

03 March 2021 6,145 3 View

Anyone plz suggest relevant topic for research in image processing+Deep learning.?

I have selected brain tumor images ...but now found that already lots of research done n this topic.

03 March 2021 5,774 3 View

How to increase a model accuracy ?

dear community, my model is based feature extraction from non stationary signals using discrete Wavelet Transform and then using statistical features then machine learning classifiers in order to...

03 March 2021 6,994 5 View

New Journal, "Integrative Psychological and Behavioral Science" -- do you not know, and have you not seen, this done before?

Question to you and THEM, the New Journal, "Integrative Psychological and Behavioral Science" -- do you not know, and have you not seen, this done before? There appears to be a core problem for...

02 March 2021 3,024 2 View

Can you share me how teacher education is managed in your respective national educational system?

I feel that the practice in teacher education in my country is below the expected performance level due to very poor management system. Hope I will learn something from your experiences.

02 March 2021 1,516 4 View

Can NFL theorem be valid in infinite search space in ML?

NFL theorem is valid for algorithms training in fixed training set. However, the general characteristic of algorithms in expanded or open dataset has not been proved yet. Could you show your...

01 March 2021 1,189 3 View

Does anyone know HRM channel in a 2 plex QIAGEN Rotor- Gene Q qPCR can be used as a separate channel?

I am going to have 3 different probes in my qPCR work that I am going to do. But I realized that the machine we have in the lab is a Rotor-Gene Q 2plex HRM Platform, saying it has green, yellow,...

01 March 2021 8,544 1 View

What is the difference between L1 and L2 regularization in machine learning?

L1 and L2 regularization

28 February 2021 4,187 3 View

How to eliminate Steady state error from Reinforcement learning genetic algorithm code?

The following code (see 1st 2 images attached) is used to produce PID controller values that are designed to control the system (G). The code finds the PID controller values (noted as k) by using...

28 February 2021 6,560 14 View

Muhammad Ali

Have a look at Article Embedding a state space model into a Markov decision process

https://beta.vu.nl/nl/Images/werkstuk-ammerlaan_tcm235-816536.pdf

https://arxiv.org/ftp/arxiv/papers/1207/1207.4115.pdf

Abhijeet Sahu

Muhammad Ali Thanks for the links. I will go through them.

Abdelkader Mohamed Elsayed

Dear Dr. Abhijeet Sahu ,

I am not a specialist, but this link will be very useful: