What are the advantages of Backpropagation through time (BPTT) training algorithm over simple backpropagation (BP)?

08 August 2013 1 9K Report

Backpropagation (BP) is most widely used training algorithm in machine learning. Over the past few years, BPTT are also used with promising results. Kindly through some light on the advantages of BTPP over BP.

Arturo Geigel

BPTT is a BP but with memory of the previous outputs. It is used more frequently to analyze features that are dependent of previous ones such as time dependent sequences (string sequence recognition, etc.).

Badges
Science topic

More Khalid Raza's questions See All

Should we publish our work as conference proceeding?

Today, scientific meetings and conferences have been commercialized. Except few renowned conferences, mostly are becoming a business platform to publish. Today, one of the big player in publishing...

10 November 2017 5,837 6 View

Which software tools are used the most for language editing?

Dear Colleagues, Apart from the originality of work, language is also one of the important parameter for the acceptance of research papers. I request my research colleagues to share their views on...

06 July 2017 2,928 3 View

How can I validate a cancer-specific Gene Regulatory Network & perform Gene Ontology Analysis?

We identified small size cancer-specific gene regulatory network (colon cancer & prostate cancer) from microarray data using computational intelligence. Now we would like to validate it with...

04 May 2014 2,695 3 View

What is the time complexity of Multilayer Perceptron (MLP) and other neural networks?

Complexity of an algorithm is mostly represented in Big O notations that plays an important role in finding efficient algorithm. What is the time complexity of MLP and other ANN?

01 February 2014 1,483 10 View

How do I plot ROC, AUROC and AUPR?

I am looking for free and open source software tool that can plot ROC, Area Under ROC and Area Under Precision Recall Curve?

11 December 2013 1,817 4 View

What are the advantages of using Extended Kalman Filtering in Neural Network Learning?

The Kalman Filter was developed in 1960 and it has been used in many real-life problems like related to linear estimation problem. Now-a-days Extended Kalman Filtering (EKF) is being used with ANN...

08 September 2013 5,777 2 View

What are the similarities and differences between a machine and a human?

Today, due to technological advancements machines are turning to be more intelligent than human being. If we compare them, there are several similarities and differences.

06 July 2013 381 2 View

How can one discretize continuous numeric values in three classes [-1, 0, 1]?

I have trained an RNN using a training data set and found a weight matrix in which I am interested. This weight matrix Wi,j contains continuous values. I have to discretize these values in three...

06 July 2013 7,428 19 View

How to biologically validate gene interaction for a particular disease?

Presently I am working on reconstruction of genetic regulatory network (GRN) from colon cancer gene expression data. I identified few deferentially expression genes (around 100) and using some...

04 May 2013 2,456 1 View

How to find activator-repressor relationships between gene pairs using fuzzy logic algorithm from microarray data?

Finding activator-repressor relationships is required for the construction of gene regulatory networks. Many statistical techniques exists for the same such as Pearson's correlation, mutual...

03 April 2013 4,832 0 View

error in running a model in Abaqus

Excessive rotation of nodes in node set ErrNodeExcessRotation-Step1

17 August 2021 0 0 View

error in modelling model in Abaqus

Excessive rotation of nodes in node set ErrNodeExcessRotation-Step1

17 August 2021 0 0 View

MD MOE RMSD

How to calculate the RMSD values for a MD simulation using MOE?

07 August 2021 0 0 View

MD MOE RMSD

How to calculate the RMSD values for a MD simulation using MOE?

07 August 2021 0 0 View

MGL tools

20 June 2021 0 0 View

fatal error

When I tried to energy minimization my system, I got fatal error as below. Fatal error: Atomtype opls_116 not found Although I've already added this line: ; include water #include "oplsaa.ff/spc.itp" to [molecultype] directive in my topology.

16 June 2021 0 0 View

fatal error

16 June 2021 0 0 View

fatal error

16 June 2021 0 0 View

fatal error

16 June 2021 0 0 View

i have some problem with chtMultiRegionSimpleFoam

--> FOAM FATAL ERROR: Maximum number of iterations exceeded From function Foam::scalar Foam::species::thermo::T(Foam::scalar, Foam::scalar, Foam::scalar, Foam::scalar (Foam::species::thermo::*)(Foam::scalar, Foam::scalar) const, Foam::scalar (Foam::species::thermo::*)(Foam::scalar, Foam::scalar) const, Foam::scalar (Foam::species::thermo::*)(Foam::scalar) const) const [with Thermo = Foam::hConstThermo >; Type = Foam::sensibleEnthalpy; Foam::scalar = double; Foam::species::thermo = Foam::species::thermo >, Foam::sensibleEnthalpy>] in file /home/ubuntu/OpenFOAM/OpenFOAM-4.1/src/thermophysicalModels/specie/lnInclude/thermoI.H at line 66. FOAM aborting #0 Foam::error::printStack(Foam::Ostream&) at ??:? #1 Foam::error::abort() at ??:? #2 Foam::heRhoThermo >, Foam::sensibleEnthalpy> > > >::calculate() at ??:? #3 Foam::heRhoThermo >, Foam::sensibleEnthalpy> > > >::correct() at ??:? #4 ? at ??:? #5 __libc_start_main in "/lib/x86_64-linux-gnu/libc.so.6" #6 ? at ??:?

24 March 2021 0 0 View