How discount factor ( reward ) exactly works in reinforcement learning? and why the discounted reward is necessary?

Hello everybody. The reward is necessary to tell the machine ( agent ) which state-action pairs are good, and which are bad. Please help me to understand the behavior of the discount factor or...

05 January 2020 7,792 1 View

Is there any way we can prove or support the consequences the proton entering the earth's atmosphere during geomagnetic condition have on human being?

During SEP event, many protons of different energy level enters the earth's atmosphere. In the history there has been several such circumstances like 12 hr power cut in Norway during 20th...

26 June 2019 7,932 2 View

If we become able to replicate the Connectome into a machine, like robot, will that robot have the power of AI and emotions?

Future possible use of connectome in machine learning. How far can we go?

03 May 2019 2,039 8 View

How to produce ferrosilicon(FeSi) alloys by induction furnace?

Hello dears FeSi and FeSiMg production process are using electric arc furnace, but I intend to produce it using an induction furnace. If there are literature or articles related to this issue,...

31 July 2018 4,473 3 View

How to Decompose a signal using S-transform ?

Can any one please explain me how to decompose a signal into different frequency bands using S-transform in Matlab , just like Wavelet decomposition ?

04 October 2017 7,413 5 View

Extracting Motor imagery data from gdf file

27 July 2017 7,485 2 View

Why Sodium P04 buffer is not a good idea for phenomenex Rezex RCM column?

25 February 2016 5,733 3 View

Please, suggest a HPLC column method for alditols (e.g. erythritol, xylitol, mannitol & sorbitol).

Read 5 answers by scientists to the question asked by Niraj Maheshwari on Feb 8, 2016

07 February 2016 4,362 4 View

At what dose and time duration of treatment do AR42J cells respond to cholecystokinin in terms of cell death and UPR activation?

I am treating AR42J cells with 10-8 M cholecystokinin (CCK) for different time intervals up to 8 hours. Following this, I need to check for markers of cell death and for activation of the Unfolded...

13 July 2015 8,212 3 View

Does anyone know how to perform 3 dimensional principal co ordinate analysis in GenAlex?

01 March 2015 5,955 2 View

Which is suitable for use with Python? MySQL or SQL Server?

Which is suitable for use with Python? MySQL or SQL Server? What is your suggestion?

01 March 2021 3,422 3 View

How to plot the probability paper of Gumbel distribution using R programing?

In R-studio, there are many commands of Gumbel package. Arguments are also different. I`m asking about the alpha parameter of the Copula which must be greater than 1. If this is the one used to...

25 February 2021 5,229 3 View

What software programs can directly simulate Additive Manufacturing Directed Energy Deposition (DED)?

I understand there are a lot of software programs that can simulate DED by going through specific modeling, simulation, and commands. For me, that was time consuming and results were not accurate....

24 February 2021 4,428 3 View

I am looking for a simple software program to model 3D chemical bonds. The purpose is to generate high-quality graphical abstracts. Any suggestion?

Hello everyone: I am looking for a simple software program to model chemical bonds. The purpose is to generate a high-quality graphical abstract for a top leading journal in the field of...

23 February 2021 8,012 3 View

How to estimate 2SLS with different instruments for different endogenous variables?

To be specific, I want to conduct an IV regression in stata with the following three equations. EQ1: Y1 ~Y2 Y3 X EQ2: Y2 ~ Z1 EQ3: Y3 ~ Z2 Both Y2 and Y3 are endogenous. However, Z1 and Z2 are...

23 February 2021 6,266 3 View

How to constrain genetic algorithm input u?

My real system (buck converter) can only take an input of 0 to 1 (duty ratio) and I need to constrain the system so the controller action keeps within this bounds. How can I do this? The code for...

22 February 2021 2,125 3 View

Are there packages (R or Python) for simple models (bucket?) to assess soil water content?

Hi everyone. I am researching droguht effects on soil water drought. I am looking for already implemented functions in R or Python to estimate soil water content from precipitation,...

21 February 2021 2,084 1 View

Which is the best software or programming language (user friendly) for analysing data?

I have a basic knowledge on Python, R and MATLAB in analysing data. Among those, which is the best and user friendly? Which one should I learn deeply to analyse data?N:B: I want to learn data...

20 February 2021 3,950 15 View

Algorithms to filter corrective max and min from a set of data?

I've got this 5 year Direct Normal Irradiance data I downloaded from https://re.jrc.ec.europa.eu/. I ordered this by year and by every 24 hours because I need the DNI curve by max in summer, min...

17 February 2021 2,777 5 View

What is/are the best ML classifier(s) for Sentinel2 images?

Hi I am trying to segment a sentinel2 image. At this stage, I want to run a binary classifier that assigns each pixel to either farm or non-farm pixel. For this purpose, I have 4 10m bands...

15 February 2021 3,596 9 View