How discount factor ( reward ) exactly works in reinforcement learning? and why the discounted reward is necessary?

Hello everybody. The reward is necessary to tell the machine ( agent ) which state-action pairs are good, and which are bad. Please help me to understand the behavior of the discount factor or...

05 January 2020 7,792 1 View

Is there any way we can prove or support the consequences the proton entering the earth's atmosphere during geomagnetic condition have on human being?

During SEP event, many protons of different energy level enters the earth's atmosphere. In the history there has been several such circumstances like 12 hr power cut in Norway during 20th...

26 June 2019 7,932 2 View

If we become able to replicate the Connectome into a machine, like robot, will that robot have the power of AI and emotions?

Future possible use of connectome in machine learning. How far can we go?

03 May 2019 2,039 8 View

How to produce ferrosilicon(FeSi) alloys by induction furnace?

Hello dears FeSi and FeSiMg production process are using electric arc furnace, but I intend to produce it using an induction furnace. If there are literature or articles related to this issue,...

31 July 2018 4,473 3 View

How to Decompose a signal using S-transform ?

Can any one please explain me how to decompose a signal into different frequency bands using S-transform in Matlab , just like Wavelet decomposition ?

04 October 2017 7,413 5 View

Why Sodium P04 buffer is not a good idea for phenomenex Rezex RCM column?

25 February 2016 5,733 3 View

Please, suggest a HPLC column method for alditols (e.g. erythritol, xylitol, mannitol & sorbitol).

Read 5 answers by scientists to the question asked by Niraj Maheshwari on Feb 8, 2016

07 February 2016 4,362 4 View

At what dose and time duration of treatment do AR42J cells respond to cholecystokinin in terms of cell death and UPR activation?

I am treating AR42J cells with 10-8 M cholecystokinin (CCK) for different time intervals up to 8 hours. Following this, I need to check for markers of cell death and for activation of the Unfolded...

13 July 2015 8,212 3 View

Does anyone know how to perform 3 dimensional principal co ordinate analysis in GenAlex?

01 March 2015 5,955 2 View

Is there a way to build a simple model of double effect chiller for control purpose?

I want to make a simple model of a double effect chiller for control purposes. I checked the literature and there some really complicated and detailed model, which are good to study and develop...

01 January 1970 5,007 2 View

Timeout error!! Processor in the loop (PIL) using STM32F4 Matlab 2018a?

Dear Researchers I am trying to perform a PIL simulation using STM32F4 Discovery board and comunication serial USB TO TTL. During simulation I receive the following timeout error: An error...

01 March 2021 2,327 1 View

How to eliminate Steady state error from Reinforcement learning genetic algorithm code?

The following code (see 1st 2 images attached) is used to produce PID controller values that are designed to control the system (G). The code finds the PID controller values (noted as k) by using...

28 February 2021 6,560 14 View

How to prevent ANFIS Model from negative prediction values in MATLAB?

I have input and output data set for "ANFIS modeling in MATLAB", and I am getting some negative predicted values of output in testing. However, the predicted values of output in training are...

28 February 2021 3,459 3 View

How does an AC-DC power supply Flyback Converter Based USB Charger Model using Matlab/Simulink looks like?

I am required to learn about Flyback converters and I got stuck not knowing to full design of the power supply flyback converter Based USB Charger Model using Simulink, especially the design model...

25 February 2021 5,435 2 View

Please. Could you help be in implementing Fractal Discrete Cosine Transform algorithm in Matlab?

I do need the Matlab code of Fractal Discrete Cosine Transform (FDCT). Can anyone who has already implement this code, help me with the implementation of this transform?

24 February 2021 5,602 2 View

D2D implementation in Matlab in Vienna LTE software?

Hi Hope you are well. Can you please share your code for D2D implementation in Matlab. I want to implement D2D in Matlab based Vienna simulator and struggling to deploy D2D. Thanks

24 February 2021 9,378 3 View

Multi effect distillation modeling in EES?

Dear colleagues If anyone has a model of multi-effect distillation in EES or MATLAB software, please send it to me.

24 February 2021 7,282 1 View

What program can I use to caclulate dipole moment efficiently and without the need of excessive computation?

Hi, I am a third year chemistry undergrad doing my group project in which I need to predict the HPLC retention time of 20 aromatic molecules. to do this we require the chemical properties of these...

24 February 2021 1,384 3 View

In frequency domain alpha band(8-16hz), beta band(16-32hz), gamma band(32-64hz), sub-band(64-128hz) are same as LL,LH,HL,HH in wavelet decomposition?

I am working on single trial motor imagery data i.e. EEG data. I am following a paper which has a dataset from BCI challenge IV (dataset 2b). After removing noise and extracting all the data from...

23 February 2021 5,503 1 View

Does anyone ever solved this following Matlab error : "Error using imaqdevice/start (line 95) pointgrey: Failed to stop the camera acquisition." ?

I use Matlab 2014b to capture some images with a PointGrey camera connected with USB3 port. I initialize the camera in a function which basically execute these followed lines : vid =...

22 February 2021 6,386 1 View