What is the structure of the reward Matrix for a hidden Markov process when formulating a Markov decision process problem?

Kizito Mubiru @Kizito-Mubiru

05 May 2015 1 7K Report

Knowing the structure will assist me to model situations where risk is a major factor

Milad Memarzadeh

Usually reward depends on current state and action but can also depend on future .state.

More Kizito Mubiru's questions See All

Economic Intelligence has taken centre stage in providing timely analytical information to policy makers. How will AI enhance Economic Intelligence?

AI refers to artificial intelligence

07 December 2023 4,980 1 View

With informality in SMEs in developing countries, how can use of economic intelligence tools to use to capture data and be able to identify problems?

Informality in business especially in Africa tends to make it difficult to plan for them because data related to their performance is not available. Which tools will economic intelligence experts...

07 December 2023 7,597 0 View

Help Calculating Sample Size for Sickle Cell Disease Screening?

The current reported disease prevalence is .6% of the population. I've tried using the formula n=Z^2(p(1-p))/M^2 with a confidence level of 95% and M=0.05 but my n value is obviously too small if...

15 May 2018 5,374 3 View

How was hegemonic masculinity among the akan communityexpressed?

domination of men over women

30 October 2015 8,356 2 View

Does a standard cost function design methodology, for wind turbine MPPT algorithms, exist?

I intend to come up with a cost function for a wind turbine MPPT algorithm. I need a design methodology that can give me the most appropriate cost function.

11 October 2015 3,057 1 View

Diary research inquiry

Dear Colleagues, Can anyone advise on the best approach which i can use to analyse qualitative data accumulated for over 6 months from TV news .

30 December 2011 2,761 3 View

Please explain how the plastic input value should be considered from the true stress-strain curve for the bilinear elastoplastic material model ?

I am working on Abaqus/Explicit(Quasistatic ) for the deformation of the auxetic structure model. Please explain how the plastic input value should be considered from the true stress-strain curve...

05 August 2024 454 3 View

"A Markov-like Model for Patient Progression"?

A Markov-like Model for Patient Progression" Markov Chain Monte Carlo (MCMC) Markov Chain Monte Carlo (MCMC) is a powerful computational technique used to draw samples from a probability...

05 August 2024 10,079 0 View

Could dyes amplify the spectrum of light to a specific wavelength?

I am interested to know the behavior of dyes toward light. Specifically, Blue dyes re-emit the spectrum, especially from the green zone (known as principal in LED lamps, and blue dyes are known...

05 August 2024 3,290 1 View

How to report results of Generalised Linear Mixed Models in a journal article?

Hi everyone, If you have written or come across any papers where Generalised Linear Mixed Models are used to examine intervention (e.g., in mental health) efficacy, could you please share the...

04 August 2024 4,130 4 View

Is it necessary to covary exogenous constructs in a structural model?

I am working on a SEM model where i have 7 latent variables (6 exogenous and 1 endogenous). In AMOS when I co-vary the exogenous constructs, only 2 paths are coming significant out of 6. But when...

03 August 2024 6,028 4 View

Why can't academics earn the money they deserve?

Only Journals make money from the articles we have worked on for years. Academics do not earn money from their refereeing. Then shouldn't the solution be a system in which academics can earn...

01 August 2024 6,469 6 View

Posthoc test lettering in JAMOVI?

Does anyone know of a module for the JAMOVI software that is capable of generating mean separations using the classic letters based on post hoc results (e.g., Tukey test)? If, as I believe, such...

31 July 2024 3,333 4 View

A Question about Phd thesis?

Hello everyone What is your opinion about the introduction of an expert decision support system in which the rules are extracted from existing data without human intervention, instead of being...

31 July 2024 5,785 4 View

Can we patent a process flow diagram developed using a process simulator but no actual cases is carried out?

Can we patent a process flow diagram developed using a process simulator but no actual cases is carried out? For example consider a process for certain product manufacture where a new process flow...

31 July 2024 781 1 View

Where to download DEM from 2018?

I am currently working on validating land subsidence results obtained using SBAS InSAR. Could anyone suggest reliable sources or repositories where I can download a historical DEM from 2018?...

31 July 2024 9,757 3 View